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boundary  layer  problems.  For  systems  with  high  frequency  oscillatory  be- 
havior, we  decompose  the  original  system  into  a slowly  varying  system  and 
a fast  oscillatory  system.  This  procedure  provides  physical  interpretations 
for  the  high  frequency  oscillations  occurring  in  a mass-spring-damper 
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initial  value  problems  [2,3]  and  optimal  control  problems  [4-8]  are  well 
documented.  One  of  the  tasks  of  singular  perturbation  analysis  is  to 
establish  whether  the  full  problem  (1.3)  is  well  posed  in  the  sense  that 
its  solution  tends  to  the  solution  of  the  reduced  problem 


* = All*  + A12Z  + *1* 

0 = A21*  + A22Z  + V 


(1.4) 


as  M-  -♦  0+.  We  have  shown  in  [8,9]  that  the  regulator  problem  of  minimizing 
system  (1.3)  with  respect  to  the  performance  index 


J = J (x'QjX  + 2x'Q2z  + z'Q3z  + u'Ru)  dt  (1.5) 

0 

can  be  solved  approximately  from  two  separate  reduced  order  regulator 

problems  for  the  reduced  system  and  the  boundary  layer  system.  Based  on 

these  independent  reduced  order  designs,  we  propose  a composite  control 

uc  such  that  the  performance  of  system  (1.3)  controlled  by  u£  is  an 
2 

0(p,  ) approximation  of  the  optimal  performance. 


1.2  Stability  Results 

Stability  properties  of  the  nonlinear  system  (1.1)  have  been 
investigated  previously  in  [10-13].  In  this  thesis  we  analyze  a special 
class  of  system  (1.1)  in  the  form 


x = a^(x)  + A^(x)z 
M'Z  = a2(x)  + A^xjz 


(1.6) 


which  is  nonlinear  in  x and  linear  in  z.  By  assuming  that  the  equilibrium 
of  the  reduced  system  of  (1.6)  possesses  a domain  of  stability  D and  that 
the  real  parts  of  the  eigenvalues  of  A2 (x)  are  negative  for  all  x e D, 
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A 


we  construct  a composite  Lyapunov  function  for  (1.6)  to  examine  some 
stability  properties.  The  main  accomplishment  here  is  that  our  predicted 
domain  of  stability  is  larger  than  those  obtained  in  previous  works 
[10-13],  An  estimate  of  the  singular  perturbation  parameter  p is  also 
given.  The  stability  results  are  applied  to  the  design  of  the  control 
for  the  system 


x = a^(x)  + A^(x)z  + B^(x)u 
pz  = a2(x)  + (x)z  + B2(x)u  . 


(1.7) 


It  is  shown  that  by  considering  separately  the  designs  of  the  controls 
for  the  reduced  system  and  the  boundary  layer  system,  we  construct  a 
stabilizing  composite  control  for  the  full  system  (1.7). 


1.3  Optimal  Control  Problems 

The  stability  results  are  utilized  in  the  design  of  the  optimal 
control  for  system  (1.7)  with  respect  to  the  performance  index 

CD 

J = J [p(x)  + s' (x)z  + z'Q(x)z  + u'R(x)u]dt  . (1.8) 

0 

Finite  time  trajectory  optimization  problems  for  the  same  class  of  systems 
have  been  treated  in  [14-16]  via  two  point  boundary  value  problems  originating 
from  necessary  optimality  conditions.  For  the  infinite  time  regulator 
problem  (1.7),  (1.8), the  Hamilton- Jacobi-Bellman  sufficiency  condition 
is  more  suitable  since  it  readily  incorporates  stability  requirements  and 
leads  to  feedback  solutions.  The  solution  to  the  Hamilton- Jacobi  equation 
is  shown  to  possess  a power  series  expansion  in  the  components  of  z and  in 
p,  similar  to  the  results  in  [17,18,5,8].  A major  advantage  of  the  series 
solution  is  that  the  coefficients  in  the  expansion  can  be  solved  from 
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equations  involving  the  slow  variable  x only.  In  particular,  the  coeffi- 
cients of  the  leading  terms  are  solved  from  the  reduced  order  problem 
and  an  algebraic  Riccati  equation.  Then  similar  to  our  approach  of  the 
linear  regulator  in  [8],  we  construct  a composite  control  for  the  full 
system  (1.7).  With  this  approach  we  avoid  the  explicit  treatment  of 
boundary  layer  phenomena  as  they  are  optimized  by  the  z-dependent  part  of 
the  composite  control  which  uses  the  variable  x as  a gain  parameter. 

For  the  fixed  endpoint  problem  of  minimizing  the  performance 
T 

J = j [V^x.t.p.)  +V^(x,t,M.)z  +z'V3(x,t,|j,)z  +u'R(x,t ,|j,)u]dt  (1.9) 

0 

of  the  system  (1.7)  with  initial  and  end  conditions 


x(0,M-)  = xq(h),  z(0»^)  = zofa) 
x(T,MO  = xT(p,),  z(T,p.)  = zT(p,) 


(1.10) 


our  approach  is  to  decompose  the  full  order  problem  into  three  lower  order 
problems,  namely,  the  reduced  problem  and  the  left  and  the  right  boundary 
layer  problems.  Thus  the  technique  in  [7]  for  linear  quadratic  problems 
is  now  extended  to  nonlinear  problems.  The  boundary  layer  problems  are 
linear  quadratic  and  contrary  to  previous  singular  perturbation  works, 
the  reduced  problem  has  a simple  formulation.  For  system  (1.7)  where 
is  unstable,  a partially  closed-loop  control  is  proposed. 


1.4  System  with  High  Frequency  Oscillatory  Modes 

Singular  perturbation  techniques  are  primarily  developed  for 


systems  of  the  type  (1.3) 


x = Ax  + Bz 
p»z  = Cx  + Dz 


(1.11) 
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where  D is  a stable  matrix.  Then  after  the  transients  in  z have  decayed, 
the  states  of  (1.11)  are  approximated  by  the  reduced  system  where  p = 0. 

In  this  thesis,  we  extend  singular  perturbation  techniques  to  systems  with 
high  frequency  oscillatory  modes  characterized  by  (1.11)  with  D a 2m  X2m 
matrix  in  the  form 


(1.12) 


where  the  eigenvalues  of  D2D3  are  negative  real  and  simple.  It  is  shown  that 
the  state  x is  primarily  a slow  variable  while  the  state  z consists  of  both 
the  slow  modes  and  the  high  frequency  oscillatory  modes.  Letting  p = 0 is 
equivalent  to  neglecting  the  high  frequency  components  of  z and  retaining 
its  averaged  value  [19,20].  The  Chang's  transformation  [21,22]  can  be  used 
to  decompose  system  (1.11)  into  a slowly  varying  system  and  a fast  oscillatory 
system.  A similar  transformation  is  applied  to  nonlinear  systems  with  high 
frequency  oscillatory  behavior.  This  decomposition  technique  is  used  to 
shov.  the  high  frequency  oscillations  in  a mass-spring-damper  system  and  an 
interconnected  power  system. 


6 


coefficients  of  the  series  are  determined  from  equations  involving  only 
the  slow  variable  x.  An  estimate  of  the  degree  of  near -optimality  of 
the  feedback  control  is  given  and  illustrated  by  a speed  control  example. 

Chapter  4 decomposes  the  fixed  endpoint  problem  (1.7),  (1.9), 
(1.10)  into  three  lower  order  problems  and  combines  the  solutions  to 
these  problems  to  yield  an  approximate  solution.  An  asymptotic  series 
solution  is  also  discussed. 

Chapter  5 proposes  a subsystem  decomposition  for  systems 
containing  high  frequency  oscillatory  modes.  Eigenvalues  and  state 
approximations  achieved  by  the  subsystems  are  given.  Nonlinear  systems 
are  decomposed  in  a similar  manner.  A mass-spring-damper  example  shows 
that  a stiff  spring  can  be  regarded  as  a perturbation  of  a rigid  rod  and 
an  interconnected  power  system  example  illustrates  the  occurrence  of 
coherency  and  intermachine  oscillations. 


7 


2.  STABILITY  RESULTS 

2.1  Introduction 

Stability  properties  of  the  nonlinear  system 
x = cp(t,x,z,p.),  x(0)  = xq 
|iz  = $ (t,x,z,p),  z (0)  = z 


(2.1) 


o 

n , „ra 


where  P-  is  a small  positive  parameter,  x,cp  e R and  z,i|i  c R > have  been 
investigated  previously  in  [2,10-13].  In  this  chapter  we  analyze  a special 
class  of  system  (2.1)  in  the  form 

x = ax(x) +Al(x)z,  x(0)  = xq 


M-z  = a2(x) +A2(x)z,  z (0)  = zq 

which  is  nonlinear  in  x and  linear  in  z. 

Letting  jx  = 0,  system  (2.2)  becomes 

x = a1(x)  + A^X)^,  x(0)  = xq 

0 = a2(1T)  + A2(x)z  . 

Assuming  that  A2(x)  is  nonsingular,  is  solved  from  (2.3b)  as 

z = -A2l(x)a2(x) 

and  its  elimination  from  (2.3a)  results  in  the  reduced  system 

x.  -i  _ 

x = a1"A1A2  a2  = aQ(x),  x(0)  = xq. 


(2.2a) 

(2.2b) 


(2.3a) 

(2.3b) 

(2.4) 

(2.5) 


To  derive  the  fast  subsystem  or  the  boundary  layer  system,  we  assume  that 
the  slow  variables  are  constant  in  the  boundary  layer,  that  is  7 ■ 0 and 
x * xq  = constant.  Substracting  (2.4)  from  (2.2b)  at  t = 0,  we  obtain 


M-(z  - z)  = A2(xq)  (z-T)  . 


(2.6) 
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Redefining  z = z-7,  we  formulate  the  fast  subsystem  of  (2.2)  as 


= A2(xq)z,  z (0)  = z0_z (0) 


(2.7) 


that  is , 


dz  . , . ~ 

S * W* 


(2.8) 


where  r = t/p.  is  the  fast  time  scale. 


Under  the  assumptions  specified  later,  the  response  of  system 


(2.2)  can  be  approximated  by 

x(t)  = x(t)  + 0(M<) 
z(t)  = z(t)  + z(t)  + 00i) 


(2.9) 


We  assume  that  systems  (2.2),  (2.5)  and  (2.7)  satisfy  the  following 
assumptions  for  all  x e D where  D is  a closed  set  in  Rn  containing  the 
origin: 

(A2.1)  The  vectors  a^,  a^  and  matrices  A^,  A2  are  bounded  and  differentiable 
with  respect  to  x,  and  a,  (x)  = 0,  a„ (x)  = 0 only  at  x = 0. 

(A2.2)  The  real  parts  of  the  eigenvalues  of  A ^ are  strictly  negative, 
that  is,  there  exists  a fixed  a < 0 such  that  Rei\(A2)}  5 
Thus  A2  is  nonsingular. 

(A2.3)  There  exists  a Lyapunov  function  L(x)  for  the  reduced  system  (2.5) 
where  L(x)  is  negative  definite,  guaranteeing  that  X = 0 is  an 
asymptotically  stable  equilibrium.  Furthermore,  the  level  surface 
L(x)  = c where  c is  a positive  constant  is  taken  to  be  the  boundary 
of  D.  Hence  D belongs  to  the  domain  of  attraction  of  x = 0. 
Assumption  (A2.2)  guarantees  that  there  exists  a positive  definite 


matrix  P(x)  such  that 


P(x)A2(x)  + A2 (x)P (x)  = -Im 


(2.10) 
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where  1^  denotes  the  i x i identity  matrix.  Then  based  on  L(x)  and  P(x), 
we  formulate  a Lyapunov  function  for  system  (2.2).  Since  the  structure 
of  system  (2.2)  is  simpler  than  system  (2.1),  we  relax  the  condition 
used  in  [2,11]  that  the  linearized  reduced  system  (2.5)  be  asymptotically 
stable.  Furthermore,  by  introducing  a small  parameter  & into  our  Lyapunov 
function  for  system  (2.2),  the  domain  of  stability  of  x = 0,  z = 0 includes 
z of  0(1/75). 


2.2  A Synchronous  Machine  Model 

As  an  example  of  system  (2.2),  we  consider  a well  known  fifth 

order  model  of  a synchronous  machine  [23].  Neglecting  the  damper  windings 

and  saturation,  the  equations  for  the  direct  and  quadrature  axis  voltages 

v,  and  v , and  the  field  flux  linkage  Y,  are 
a q r 


■V 


(L,Lr~Mj -)  di,  M,,  dy,  L Hi 
v d f df  d . df  . q q 


r L, 
a f 


dT 


raLf 


dT 


(2.11) 


v 

_a 

r 

a 


. Lo  dl„  <LdLf-^f>ntd  

Lq  r dT  r L,  ^ r L 


'a  f 


<2.12) 


a f 


L dY  L v 

— — -=■  = -y  -m  i + r 1 
r dT  *f  "df  d + rf 


(2.13) 


where  i , L_,  i , L are  the  currents  and  reactances  of  the  d-  and  q-axes, 
a d q q 

respectively,  is  the  armature  resistance,  v^,  L^,  r^  are  the  field 
voltage,  reactance  and  resistance,  respectively,  is  the  mutual  reactance 
between  the  d-axis  and  field  circuit,  A is  the  instantaneous  per  unit 
angular  velocity  of  the  rotor  and  T is  the  per  unit  time.  The  swing  equation 
is 
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where 


<W&> 


<LdV“5f> 


(2.20) 


Similarly  we  rewrite  (2.13),  (2.14),  (2.15)  in  the  slow  time  scale.  The 

resulting  system  has  the  form  (2.2)  in  which  the  slow  variables  are  V,  ft 

and  Y,  and  the  fast  variables  i.  and  i whose  derivatives  are  multiplied 
f d q 

by  M>,  appear  linearly  in  these  equations. 

Letting  p,  = 0,  the  slow  subsystem  of  (2. 11)- (2. 15)  is 

&r  =.  ^ <ff-ft  ) 

dT'  r , ' o' 


M,,Y,i 
df  f c 


dT'  2 Hr,,  'in 


(2.21) 


d*f  - - LfVf 

d^  " 'Wd  + — 


where  the  slow  parts  of  i^  and  i^  satisfy  the  algebraic  equations 


L ft  i 


T = ^d  + r 

a a 


<Va n . Mdf“, 


(2.22) 


The  fast  subsystem  is 


di . L ft  i 

-1.-1+  -9 5 

dT"  d r 

a 


<LfV^f)fnd  . ^ 


V»Lf 


(2.23) 


where  T"  = t'/p--  It  is  crucial  that  in  (2.23)  the  slow  part  ft  is  regarded 


as  a constant. 
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The  slow  subsystem  (2.21)  is  analogous  to  Kimbark's  third  order 
model  [24].  Instead  of  neglecting  di^/dT,  di^/dT  as  it  was  in  [24],  we 
set  |i  * 0 to  obtain  the  slow  subsystem.  We  also  obtain  the  fast  subsystem 
(2.23)  governing  the  transient  behavior  of  id  and  i^.  Since  this  order 
reduction  is  caused  by  a parameter  perturbation  from  M.X)  to  M-  = 0,  we  are 

— — — A 

able  to  use  approximations  of  the  type  Y~Y,  Q’  Yf-V  *d-Td  + *d  and 
i ~I  + i . 

q-  q q 

2.3  A Composite  Lyapunov  Function 

With  the  change  of  variables 


T]  = z + A2  a2 


(2.24) 


exhibiting  T]  as  the  fast  part  of  z,  system  (2.2)  becomes 


x = a + A.T],  x(0)  = x 

o 1 o 

M>T|  = ^(A21a2)xaQ  + [A2  + * 


(2.25a) 


- tif(x)  + [A2(x)  + HF(x)]T],  T1(0)  = zq+  A2  (xQ)a2(xo)  (2.25b) 

where  the  subscript  x denotes  partial  differentiation  with  respect  to  x. 

Since  the  right-hand  side  of  (2.25b)  is  an  0(P>)  perturbation  of  A2(x)T| 
and  Rel\(A2)]  < 0 in  D,  we  expect  that  T|  will  rapidly  decay  to  an  0(|i) 
quantity.  This  motivates  the  introduction  of 


U(x,Tl,C)  = L(x)  + CH'P(x)Tl 


(2.26) 


as  a tentative  Lyapunov  function  for  system  (2.25).  Here  £ is  a small 
positive  scalar  to  be  determined.  From  Assumption  (A2.3)  and  (2.10),  L(x) 
and  P(x)  are  positive  definite  in  D.  Hence  U is  positive  definite  for  all 
x«D  and  T(eRm.  Furthermore,  since  L(x)  * c > 0 for  all  x on  the  boundary 
of  D,  the  surface 


a u 
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8(1,11,6)  * {x,Tl  : U(x,Tl,£)  - c]  (2.27) 

is  closed  in  the  (n +m) -dimensional  domain  X6D,  T^eR111.  We  define  Sin  to  be 
the  domain  in  the  interior  of  S. 

Let  be  a set  strictly  in  the  interior  of  D,  that  is,  the 
boundary  of  does  not  intersect  the  boundary  of  D,  and  let  E be  a bounded 

set  in  Rm.  The  presence  of  £ in  U extends  S to  encompass  (x,T\)  for  all 
xeD^  and  for  T)  in  any  prescribed  set  E.  This  crucial  result  is  stated  as 
follows. 

Lemma  2.3.1 

If  Assumptions  (A2.2)  and  (A2.3)  are  satisfied,  then  there  exists 
an  £ > 0 such  that  the  domain  Sin  contains  all  xeD^,T|eE. 

Proof : At  each  point  x«D^,  the  projection  of  S onto  the  T|  subspace  is  the 
ellipsoid 

'p (x)Tl  =*  (c-L(x))/£  (2.28) 

implying  that  extends  to  0(1 /J&) . Hence  for  every  x,  there  exists  an  £ (x) 
sufficiently  small  such  that  the  ellipsoid  (2.28)  includes  all  1]eE.  (Note 
that  we  must  exclude  the  boundary  of  D because  from  (2.28)  the  projection 

of  S at  any  point  on  the  boundary  of  D is  a single  point  T|  =»  0.)  Hence 

_ * <« 

choosing  £ to  be  the  smallest  of  such  £(x),  the  domain  contains  all 
x«D^,  %E  for  any£e(0,£*]. 

By  virtue  of  Lemma  2.3.1,  the  initial  condition  11(0)  of  (2.25b), 
and  hence  z(0)  of  (2.2),  can  be  as  far  away  from  zero  as  0(1  /V^)  and  still 
be  enclosed  by  S.  We  now  examine  the  relationship  between  £ and 
The  time  derivative  of  U with  respect  to  (2.25)  is 

» - -g(x,£,iO  - S'S  - | T1'M(x,T1,  h)11 


(2.29) 


where 


g * gl  ” 2£  y y 


gl  = - Lxao 


y * A'L'  + 2£Pf 
1 lx 

5 -\j 


(2.30) 


M = I /2  - M-(PF  + F'P)-M-P 
m 


Since  PF  + F'P  and  P are  bounded  for  all  x,Tl  in  S^n»  it  follows  that  there 

exists  a H*  > 0 such  that  M > 0 for  all  x,^i  in  S.  and  for  M-e(0,p.*].  Thus 
1 in  i 

the  last  two  terms  in  U are  positive  definite.  To  ensure  that  g(x,£,p.)  is 
positive  definite,  we  assume  that  the  reduced  system  also  satisfies 
(A2.4)  The  limit 


|x|-*0  gl 


(2.31) 


exists  for  all  fixed  £ > 0. 

Note  that  k > 0 because  y'y  is  positive  definite  and  from  Assumption  (A2.3), 
is  also  positive  definite.  The  limit  (2.31)  implies  that  there  exists  a 
domain  1)  about  x * 0 such  that 


y’y  < (1  + k)gl 


(2.32) 


Then  for  p>  < 2£/(l+k),  g is  positive  definite  in  15,  see  (2.30).  Let 
k(£)  > 0 be  the  minimum  value  of  g^  on  the  boundary  of  T).  Hence  in  the 
domain 


Dj_(x)  = (x  : gt(x)  < k} 


(2.33) 


g is  positive  definite.  On  the  other  hand,  since  D is  bounded,  there 
exists  a k, (£)  > 0 such  that  y'y  < k for  all  xeD.  Thus  g is  positive 


definite  when  x is  not  in  the  domain 
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D(x)  = [x  : gL(x)  < n-kj^/26} 


(2.34) 


about  the  origin.  But  for  p < 2£k/k^,  DCD^,  implying  that  g is  positive 
definite  in  D.  Thus  U is  negative  definite  for  all  x,T]  contained  in  S^. 
We  now  conclude  that  U is  a Lyapunov  function  for  (2.25)  guaranteeing 
that  x = 0,  T]  = 0 is  asymptotically  stable  for  all  xeD^,  7]eE  and  for 


pe(0,p  ],  where 


* 2 P 2£k  * 

^ = min(i7k  * ’ *V' 


(2.35) 


Returning  from  the  T|  variable  to  the  z variable  via  z = T]-^  a^, 
we  obtain  for  all  x€D^,  T]6E  a corresponding  bounded  domain  for  z.  We 
summarize  the  above  discussions  as  follows. 

Theorem  2.3.1 

If  Assumptions  (A2.1)-(A2.4)  are  satisfied,  then  there  exists  a 

JL 

P >0  that  for  all  ^6(0, M-  ] and  for  all  x«D^  and  z in  any  prescribed  bounded 
set  E^,  the  origin  x = 0,  z = 0 of  system  (2.2)  is  asymptotically  stable. 

Theorem  2.3.1  can  be  applied  in  two  different  directions.  As 
outlined  above,  for  any  given  and  E^,  we  first  find  £ such  that  Sin 
of  (2.27)  contains  all  xeD^,  zeE^.  Then  we  find  P*  from  (2.35).  This 
direction  is  suitable  when  Ms  a parameter  at  the  designer's  disposal, 
such  as  a gain  factor  [25].  In  the  other  direction,  if  p represents  some 
given  physical  parameters,  such  as  time  constants,  we  use  its  value  to 
determine  the  smallest  £ such  that  U of  (2.29)  is  negative  definite,  that 
is  we  find  the  largest  and  E^. 

A sufficient  condition  for  the  reduced  system  (2.5)  to  satisfy 
Assumption  (A2.4)  is  the  following: 
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(A2.5)  There  exists  a positive  definite  matrix  Q(x)  satisfying  the  x- 
dependent  algebraic  Lyapunov  equation 


Q(x)aox(x)  + a^x(x)Q(x)  = -C(x) 


(2.36) 


for  some  differentiable  positive  definite  matrix  C(x)  and  for  all 
xeD.  Let  the  matrices  G(x)  and  N(x)  be 


G(x)  = 2Q(x)aox(x)  + K(x) 


n 


N(x)  = Qaox  + a;xQ  +£  ^a^  -C  + ^ Q^. 


(2.37a) 


(2.37b) 


where  K is  a matrix  whose  jth  column  is  ((^  aQ)  and  x.,  aQ . are  the  jth 
components  of  the  vectors  x,  aQ,  respectively.  It  is  assumed  that  G 
bounded  and  \(N(x))  < for  a fixed  < 0. 

The  meaning  of  Assumption  (A2.5)  is  that  the  reduced  system  (2.5) 
possesses  a Lyapunov  function  L(x)  of  Krasovskii's  type  [26],  [27,  p.  38], 
that  is, 

L(x)  = a^(x)Q(x)aQ(x)  > 0,  L(0)  = 0 (2.38) 


such  that  L_(x)  = a' (x)G(x)  and 
x ° 


L(x)  = a^(x)N(x)aQ(x)  < 0,  L(0)  = 0 

Thus  the  origin  x = 0 of  (2.5)  is  an  asymptotically  stable  equilibrium. 
Without  loss  of  generality,  D is  chosen  such  that  L(x)  = c for  a fixed 
c > 0 and  all  x on  the  boundary  of  D. 

From  (2.30)  and  (2.25b),  we  obtain 

-1 


(-39) 


y = [A|G'  + 2£P(A2  a2)x]aQ  s Y a 


(2.40) 
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and  the  limit  (2.31)  is  bounded  by 


, a'Y'Y  a 

lim  ^ = lim  ° 0 


x|-K) 


g 


i I i ,y\  -a'N  a 
1 | x | -*0  o o 


< lim 


a, a'  a 
loo 


a. 


I | at- a'  a 
|x|^0  2 o o 


(2.41) 


where  ar^  is  the  largest  eigenvalue  of  Y'Y  and  a ^ is  the  smallest  eigenvalue 
of  -N  for  all  xeD.  We  summarize  this  result  as  follows. 

Corollary  2.3.1 

If  Assumptions  (A2.1),  (A2.2)  and  (A2.5)  are  satisfied,  then  the 
conclusion  of  Theorem  2.3.1  holds. 

As  a special  case  of  Assumption  (A2.5),  consider  when  the  origin 
x = 0 of  the  reduced  system  (2.5)  is  exponentially  stable.  Then  near  the 
origin,  |aQ(x)|  grows  as  (x(  and  we  can  find  L(x)  such  that  L(x)  grows  as 
|x|  and  |L^(x)  | grows  as  |x|.  Hence  there  exist  positive  constants 
and  6 such  that 

k2  | x | 2 < L(x)  < k3 1 x | 2 
I x | 2 < -LxaQ(x)  < k5 | x | 2 


k6UI  <Ilx(x)  | < k? i x I 

k8l*l  <UQ(x)i  1 k9lxl 


(2.42) 


for  all  | x ( < 6. 
such  that 


It  follows  from  (2.42)  that  there  exists  a fixed  k^^C-)  > 0 


(2.43) 
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and  the  limit  (2.31)  is  bound  by 


111  ^ 1 
|x|-*0  81 


(2.44) 


satisfying  Assumption  (A2.4). 

In  this  case  a claim  stronger  than  Theorem  2.3.1  can  be  made. 
Corollary  2.3.2 

If  Assumptions  (A2.1)-(A2.3)  are  satisfied  and  the  origin  X = 0 
of  the  reduced  system  is  exponentially  stable,  then  the  conclusion  of 
Theorem  2.3.1  holds  and  moreover  the  origin  x = 0,  z = 0 of  (2.2)  is 
exponentially  stable. 

Proof:  The  first  part  of  the  corollary  follows  from  Theorem  2.3.1.  The 
second  part  follows  from  the  linearization  of  (2.2)  at  the  origin 


6x 

daL  (0) 
dx 

Ax(0) 

6x 

<5z 

x da2(0) 
p.  dx 

1 

/"N 

O 

CM 

< 

r~,l  zi 

6z 

(2.45) 


The  system  matrix  of  (2.45)  has  one  group  of  n small  eigenvalues  0(M-)  close 

da-, 

am  I / I 

and  another  group  of  m large  eigenvalues 


*1  -1  ^a2 
to  those  of  ( rg—  -A1A2  ^~) 


x=0 


1 -1  c 

0(1)  close  to  those  of  — A2(0)  [22].  But  a^-A^A2  a2  = aQ  and 

dal  -1  da2 

<aT-AiA2 


1 x=0 


x=0 


as  a2(0)  = 0.  Thus  the  real  parts  of  the  eigenvalues 


of  the  system  matrix  of  (2.45)  are  all  negative  and  x = 0,  z = 0 is 


exponentially  stable. 

If  the  origin  x = 0 of  the  reduced  system  is  asymptotically  stable 
but  does  not  satisfy  Assumption  (A2.4),  then  in  general  g need  not  be  positive 
definite  for  all  xeD.  For  this  situation  the  system  is  now  shown  to  possess 
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a weaker  stability  property,  that  is,  its  trajectories  tend  to  a small  sphere 
around  the  origin.  Define  the  domain  in  Rn 

p(x)  = tx  : g(x,e,PO  1 0}  (2.46) 

which  is  contained  in  the  domain  D of  (2.34).  Due  to  the  presence  of  M-  in 
(2.29),  U may  be  positive  only  if  xep  (x)  and  ^ = Q^).  Otherwise,  U is 
negative.  Defining  the  surface 

TT(x,z)  = {x,z  : xep(x),  z = -A^ (x)a2 (x) } (2.47) 

about  the  origin  in  R11^11,  this  stability  result  is  formulated  in  the  following 
theorem. 

Theorem  2.3.2 

If  Assumptions  (A2. 1)- (A2 .3)  are  satisfied,  then  there  exists  a 
p,*  > 0 such  that  for  all  ^>6(0,^*]  and  for  all  x®D^,  zeE^,  the  states  of  the 
full  system  (2.2)  converge  0(M<)  close  to  the  surface  tt(x,z). 

Proof:  Since  U > 0 and  U < 0 except  for  xep  (x)  and  T]  = 0 (M<) , x converges  to 
p (x)  and  T|  decays  to  an  0(p.)  quantity.  Thus  in  the  x,z  variables,  (x,z) 
converges  to  an  0(M-)  neighborhood  of  the  surface  rr(x,z). 


2.4  Example 

We  now  demonstrate  the  construction  of  the  Lyapunov  function  U of 
(2.26)  for  the  system 


x = 

M-z  = 


xz 


2 


-x 


- z. 


(2.48) 


Letting  M-  =0,  we  obtain  z = -x  and  the  reduced  system 

-3 

-x 


X = 


(2.49) 
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Then  the  origin  x = 0 is  the  unique  asymptotic  stable  equilibrium  but  the 

linearization  of  the  reduced  system  at  x = 0 fails  to  provide  any  stability 

_2 

information.  For  system  (2.49),  Q(x)  = l/(4x  ) satisfies  Assumption  (A2.5) 
and  a Krasovskii's  type  of  Lyapunov  function  is 


L(5?)  = £ x4 , L(x)  = -x6 


(2.50) 


Let  D be  the  interval  [-1,1],  that  is,  L = c=  ^atx=±^* 

2 

Using  the  change  of  variables  “H  * z + x , system  (2.48)  becomes 


x = -x3  + xll 

MTI  = -2p.x4  + (-1  + 2p.x2)Tl 


(2.51) 


Since  we  require  |x|  < 1,  p is  restricted  to  be  less  than  1/2.  The  tentative 
Lyapunov  function  (2.26)  for  (2.51)  is 


U(x,TU)  = £ x4  + | -q2  . (2.52) 

If  we  require  that  the  initial  conditions  of  (2.52)  be  in  |x|  < .8,  |T]|  < 4, 
then  we  must  set  £ to  be  less  than  .01845  in  order  for  the  ellipse 


S(x,Tl,£)  = {x,T|  :U  = £x4+|t12  = £}  (2.53) 

to  enclose  these  initial  conditions.  Plots  of  S in  the  x,T]  coordinates 
and  the  x,z  coordinates  for  £ = .018  are  shown  in  Figure  2.1. 

The  time  derivative  of  U with  respect  to  (2.51)  is 

if  = -(gt  - £ y2)  - |r  l2  - Mil2  (2.54) 

where 
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2 

Since  lim  y / g =0,  Assumption  (A2.4)  is  satisfied.  For  all  x,T)  in  the 
x-*0 

interior  of  S and  £ = .018,  U is  negative  definite  for  all  ^6(0,  .018]. 
Hence  x = 0,  z=0  is  asymptotically  stable  for  all  |x|  < .8,  |z  + x^|  < 4 
and  M>e  (0,  .018]. 


2.5  A Stabilizing  Feedback  Control 

The  results  in  Section  2.3  are  now  applied  to  the  design  of  a 
stabilizing  control  u®Rr  for  the  system 


x = a^(x)  + A^(x) z +B1(x)u 
|J.z  = a2(x)  + A2(x)  z +B2(x)u  . 

Formally  letting  p.  * <J,  the  reduced  system  of  (2.56)  is 

x = (a1-A1A21a2)  + (B^AjA^B^u  = aQ(x)  + Bq(x)u. 


(2.56) 


(2.57) 


Systems  (2.56)  and  (2.57)  are  assumed  to  satisfy  the  following 
conditions  for  x£D: 

(A2.6)  In  addition  to  Assumption  (A2.1),  the  matrices  B^  and  B2  are 
bounded  and  differentiable  with  respect  to  x. 

(A2.7)  A2  is  nonsingular  and 

rank[B2,  A^, . . . .A™"1^]  =m  . (2.58) 

(A2.8)  There  exists  a vector  h(x)eRr  with  h(0)  = 0 such  that  the  system 

x = a q(x)  + Bq (x)h(x)  (2.59) 

satisfies  Assumption  (A2.3). 

By  Assumption  (A2.7),  we  can  find  H(x)  such  that 


Re{\(A2  + B2H)}  < <?2 


(2.60) 
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for  a fixed  < 0 and  for  all  xeD.  Assumption  (A2.8)  implies  that  there 
exists  a stabilizing  feedback  control  for  system  (2.57) 

u(x)  = h(x)  (2.61) 

such  that  the  reduced  system  (2.59)  possesses  a Lyapunov  function  guaranteeing 
that  the  equilibrium  x = 0 is  asymptotically  stable.  From  the  reduced  control 
(2.61)  and  the  inequality  (2.60),  we  formulate  a stabilizing  feedback  control 
for  (2.56). 

Theorem  2.5.1 

If  Assumptions  (A2.6)-(A2.8)  are  satisfied,  then  there  exists  a 
p.*  > 0 such  that  for  all  M-e(0,  p.*] , the  control 

u(x,z)  = (In  + H(x)A^1(x)B2(x))h(x)  + H(x)A^1(x)a2  (x)  + H(x)z  (2.62) 


where  H(x)  satisfies  (2.60),  steers  all  xeD^,  zeE^  of  system  (2.56)  0(p0 
close  to  a surface  near  the  equilibrium  x = 0,  z = 0.  Furthermore,  if  the 
reduced  system  also  satisfies  Assumption  (A2.4),  then  the  equilibrium  x = 0, 
z = 0 of  system  (2.56)  controlled  by  (2.62)  is  asymptotically  stable. 

Proof:  System  (2.56)  controlled  by  (2.62)  becomes 


x = a.  + B.(I  +HA'LB„)h  + B.HA^a.  + (A.  +B.H)z 
i in  L L ill  ii 

(iz  = a2  + B2(In  + HA‘1B2)h  + BjHA^aj  + (A2+B2H)z  . 


(2.63) 


Letting  p.  = 0,  the  reduced  system  of  (2.63)  is 

x=  (a1+B1HA21a2)  - (Aj.  + BjH)  (A2  + B2H) ~l  (a2  + BjHA*^) 

+ (Bx- (Ax  + BlH) (A2  + B2H)_1B2) (In  + HA21B2)h 

- a (x)  + B (x)h(x) 
o o 


(2.64) 


T 
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function  (2.26)  for  system  (2.63).  Then  the  conclusions  of  this  theorem 
follow  from  Theorems  2.3.1  and  2.3.2. 


Theorem  2.5.1  outlines  a low  order  design  where  the  reduced  system 
and  the  boundary  layer  system  are  considered  separately.  In  addition,  the 
parameter  M-  is  not  required  to  be  known  exactly  provided  that  it  is  sufficiently 
small.  The  result  here  is  a generalization  of  our  design  for  linear  time- 
invariant  singularly  perturbed  systems  [28], 


2.6  Discussion 

In  this  chapter  we  have  formulated  some  stability  results  for  the 
nonlinear  system  (2.2).  Based  on  the  stability  properties  of  the  reduced 
system  (2.5)  and  the  fast  transients  in  z,  a composite  Lyapunov  function 
(2.26)  is  constructed  to  show  stability  properties  of  the  full  system  (2.2). 
Since  the  structure  of  system  (2.2)  is  simpler  than  (2.1),  the  conditions 
we  derived  are  easier  to  apply  to  (2.2)  than  the  conditions  derived  in  [10- 
13]  for  (2.1).  We  also  relax  the  condition  used  in  [2,11]  that  the  linearized 
reduced  system  (2.5)  be  asymptotically  stable.  Furthermore,  the  introduction 
of  the  small  parameter  G in  (2.26)  enables  us  to  substantially  enlarge  our 
predicted  domain  of  stability.  This  feature  is  lacking  in  previous  works. 
These  results  are  readily  incorporated  in  the  design  of  a stabilizing  control 
for  system  (2.56)  and  in  the  design  of  nonlinear  regulators  which  is  treated 
in  Chapter  3. 
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3.  SINGULARLY  PERTURBED  NONLINEAR  REGULATOR 
3.1  Introduction 

Compared  with  the  rich  literature  on  linear  regulator  theory, 
publications  dealing  with  feedback  design  of  nonlinear  systems  are  a small 
minority.  Realistic  approaches  to  the  difficult  nonlinear  feedback  control 
problem  usually  exploit  properties  of  special  classes  of  systems  to  develop 
approximate  methods  [17,18,29].  The  approach  in  this  paper  exploits 
multiple  time  scale  properties  of  a class  of  nonlinear  singularly  perturbed 
systems  [14-16]  to  achieve  stabilization  and  near-optimality.  Due  to  a 
separation  of  time  scales,  the  proposed  design  procedure  is  applicable  to 
higher  order  systems. 

The  problem  considered  is  to  optimally  control  the  nonlinear  system 
x = a^ (x)  + A^(x)z  + B1(x)u  , x(0)  = xq  (3.1a) 

M-z  = a2(x)  + A2(x)z  + B2(x)u  , z(0)  = zq  (3.1b) 

with  respect  to  the  performance  index 

00 

J = ^ [p(x)  + s'(x)z  + z'Q(x)z  + u'R(x)u]dt  (3.2) 

where  > 0 is  the  small  singular  perturbation  parameter,  x,  z are  n-,  m- 
dimensional  states,  respectively,  and  u is  an  r-dimensional  control.  It  is 
assumed  that  there  exists  a domain  D c r"  containing  the  origin  such  that  for 
all  xeD  and  zeRm  the  problem  satisfies  the  following  assumptions: 

(A3.1)  The  functions  a^,  a^,  A^,  A2>  B^,  B2>  p,  s,  Q and  R are  differentiable 
with  respect  to  x a sufficient  number  of  times  and  a^,  a2>  p and  s 
are  all  zero  only  at  x * 0. 
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(A3. 2)  The  matrices  Q(x)  and  R(x)  are  positive  definite,  that  is 

Q(x)  > 0,  R(x)  > 0.  Furthermore , the  scalar  function  p + s'z  + 
z'Qz  of  x and  z is  positive  definite  in  both  x and  z. 

(A3. 3)  For  every  fixed  xeD 

rank[B2>  A^,...^™  =m  (3.3) 

and  hence  A2(x)  is  assumed  to  be  nonsingular.  (If  not,  then 
using  u = u + K(x)z  such  that  A^  + I^K  is  nonsingular  we 
redefine  the  problem.) 

Assumptions  (A3.1)  and  (A3.2)  establish  that  the  origin  is  the 
desired  equilibrium  of  (3.1).  Assumption  (A3. 3)  and  Q(x)  > 0 simplify  the 
derivations.  Alternatively  a less  restrictive  stabilizability-detectability 
condition  can  be  used. 

Finite  time  trajectory  optimization  problems  for  the  same  class 
of  systems  have  been  treated  in  [14-16]  via  singularly  perturbed  two  point 
boundary  value  problems  originating  from  necessary  optimality  conditions. 

The  resulting  controls  are  open-loop  and  require  boundary  layer  correction 
terras  at  both  ends  of  the  interval.  For  the  infinite  time  regulator  problem 
considered  here  the  Hamilton-Jacobi-Bellman  sufficiency  condition  is  more 
suitable  since  it  readily  incorporates  stability  requirements  and  leads  to 
feedback  solutions.  Using  this  condition  we  obtain  near-optimal  stabilizing 
controls  in  feedback  form  and  avoid  explicit  treatment  of  boundary  layer 
phenomena. 

Our  procedure  is  based  on  a nested  power  series  expansion  of  the 
optimal  value  function  in  z and  p.  An  advantage  of  this  procedure  is  that 
it  uses  lower  order  equations  involving  only  the  slow  variable  x.  In 
applications  truncated  series  are  of  interest.  Based  on  the  results  in 
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Li 


Chapter  2,  stabilizing  properties  of  various  truncated  designs  are  discussed. 


Furthermore,  near-optimality  of  these  truncated  designs  is  established  in 

,2. 


terms  of  0(p.),  0(M<  ),  etc.  The  proposed  design  is  illustrated  by  a speed 
control  example. 


3.2  A Speed  Control  Example 

To  illustrate  a physical  system  whose  dynamics  are  represented 

I 

by  (3.1),  we  consider  a DC  motor  model 
di„ 


Lf  IT  = ' Vf  + vf 


di 


L -r—  = - R i - c.iJM  + V 
a dt  a a 1 f a 


(3.4) 


du) 


J - - V“  + Vf1. 


where  i,,  Rf,  Lf,  V,,  i , R , L , V are  the  currents,  resistances,  induct- 
r r > i i a a a a 

ances,  voltages  of  the  field  and  armature  circuits,  respectively,  J is  the 
inertia  of  the  rotor,  c^  the  back  emf  constant,  c ^ the  viscuous  damping  and 


c^  the  torque  constant.  It  is  desired  to  maintain  the  speed  U)  constant  at 


a)  = is*,  while  the  other  equilibrium  values  are  i*,  i*,  V*,  V*. 


Since  the  field  time  constant  T^  * L^/R^  muc*1  larger  than  either 


the  armature  time  constant  T = L /R  or  the  mechanical  time  constant 

a a a 


i*2 , 


T = J/(c„  + c,c_  i*  /R  ),  we  identify  i,  as  slow  variable  and  i and  u>  as 
mzijta  t a 


the  fast  variables,  and  let  * T /T,.  For  the  DC  motor  whose  specifications 

Si  I 


are  given  in  Appendix  A,  this  relationship  is  satisfied  as  T^  * .0170  sec., 

T * .0966  sec.,  T,  ■ 2.71  sec. and  = .00625. 
m f 


J 


2.71  sec. and 


.00625. 
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Defining  the  variables 


x = i,-i*,  2 = i -i*,  z„  = iu-uj* 

f f 1 a a 2 

u = V,-V*,  u = V -V* 
l ii  / a a 


(3.5) 


the  system  equation  (3.4)  for  this  DC  motor  can  be  expressed  in  the  form 


(3.1)  with 


a^(x)  = -.369  x 


‘-5.25 


a2  (x) 


3.80  X 10 


Al(x)  = [0  0] 


' -.369 

(x)  = , 

_ 1.33  X 10  (128.5  + x) 


-10.5(128.5  + x)“ 


-2.33  X 10 


(3.6) 


Bl(x)  = [.388  0] 


B2(x) 


3.3  The  Reduced  Control 


In  singular  perturbation  techniques,  a problem  for  the  full  order 
system  (3.1)  where  > 0 is  interpreted  as  a perturbation  of  a reduced  problem 


x = a^(x)  + A^(x)z  + (x)u,  x(0)  = xc 

0 = a2(x)  + A2(x)z  + B2(x)u 


(3.7a) 


(3.7b) 


in  which  p.  = 0.  Due  to  Assumption  (A3. 3),  z can  be  solved  from  (3.7b)  and 
eliminated  from  (3.7a)  and  (3.2).  Then  the  reduced  problem  is  to  optimally 


control  the  system 


x = ao(x)  + Bq(x)u  > X(0)  = XQ 


(3.8) 


with  respect  to 


where 


Jo  = I (PQ(x)  + 2s^(x)u  + u'RQ(x)u]dt 
0 


(3.9) 


ao  = al  “ A1A2  a2 


Bo  = B1  - A1A2  B2 

Pq  = p - s'A“1a2  + 

So  = B2A2_1(QA2la2  " 2 S) 
Rq  = R + B^^QA"^  . 


(3.10) 


The  origin  x = 0 is  the  desired  equilibrium  of  the  optimally  controlled 
reduced  system  (3.8)  for  all  xeD,  since,  in  view  of  Assumption  (A3. 2), 


a (0)  = 0 and 
o 


Pq(x)  + 2s'(x)u  + u'Rq(x)u 


(3.11) 


is  positive  definite  in  x and  u. 

The  reduced  problem  (3.8),  (3.9)  is  considerably  simpler  than  the 
original  problem  (3.1),  (3.2)  because  of  the  elimination  of  the  fast  variables 
and  the  reduction  of  the  system  order.  One  of  the  tasks  of  the  singular 
perturbation  analysis  is  to  establish  whether  the  full  problem  is  well  posed 
in  the  sense  that  its  solution  tends  to  the  solution  of  the  reduced  problem 
as  |i  1 0.  If  so,  then  the  next  task  is  to  deduce  the  properties  of  the 
original  problem  from  the  properties  of  the  reduced  problem.  Finally  these 
properties  are  to  serve  as  a basis  for  a simplified  design  procedure. 
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To  formulate  our  basic  assumption  about  the  properties  of  the 


solution  of  the  reduced  problem  we  use  the  optimality  principle 


0 = minfp  (x)  + 2s' (x)u  + u'R  (x)u  + L_(a  (x)  + B (x)u)] 
i—  o o o o o 

u x 


(3.12) 


where  L(x)  is  the  optimal  value  function  and  L_  is  its  partial  derivative 

x 

with  respect  to  x.  This  yields  the  minimizing  control 


u (x)  = -R-1 (s  + 7 B'L') 
o ' ovo  2 o jr 

whose  elimination  from  (3.12)  results  in  the  Hamilton-Jacobi  equation 

0 = (p  - s'R_1s  ) + L (a  - B R_1s  ) - 7 L B R'Vl'  , L(0)  = 0. 

vlo  o o o'  7 0 000  4 5?  o 007 


(3.13) 


(3.14) 


Note  that,  due  to  (3.11),  p^  - S'Q^Q  is  positive  definite  in  D.  Our 
crucial  assumption  is  then  stated  as  follows. 

(A3. 4)  The  unique  positive  definite  solution  L(x)  of  (3.14)  exists  in  D 
and  is  differentiable  with  respect  to  x a sufficient  number  of 


times.  Furthermore  the  level  surface  L = c = constant  is 
taken  to  be  the  boundary  of  the  set  D. 

In  the  special  case  considered  in  [17],  where  the  linearization  of  (3.8) 
at  x = 0 is  stabilizable  and  its  states  are  observable  in  the  quadratic 
approximation  of  Jq,  our  Assumption  (A3. 4)  is  automatically  satisfied  for 
all  x near  the  origin.  It  follows  from  Assumption  (A3. 4)  that  uq  is  the 
unique  optimal  feedback  control  for  the  reduced  problem  and  L is  a Lyapunov 
function  of  the  optimally  controlled  reduced  system 


x = a -BR^(s  +7  B'L!)  = a (x) 
O O O ' O 2 o o 


(3.15) 


establishing  that  the  origin  is  asymptotically  stable  and  the  set  D belongs 
to  its  domain  of  attraction. 


Vi  u 
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3.4  The  Composite  Control 

The  optimal  value  function  VCxjZ.M')  of  the  full  problem  (3.1), 

(3.2)  satisfies  the  equation 

0 = min[p  + s'z  + z'Qz  + u'Ru  + Vx(a^  + A^z  + B^u)  + 
u 

jj-  Vz(a2  + A2z  + B2u)]  (3.16) 

where  V , V denote  the  partial  derivatives  of  V with  respect  to  the  variables 
X z 

x,  z,  respectively.  The  minimizing  control  of  (3.16)  is 

u = - \ r_1(b;v;  + £ B'v;)  (3.17) 

and  its  substitution  into  (3.16)  yields  the  Hamilton- Jacobi  equation 

* 

0 = p + s'z  + z'Qz  + Vx(aL  + A^z)  + £ Vz(a2  + A2z) 

" \ (VxBl  + jT  VzB2)R"1(BlVx  + JI  B2Vz} * V(0,0,p)  - 0 . (3.18) 

Since  system  (3.1)  is  linear  in  z and  J in  (3.2)  is  quadratic  in 
z,  and  since  z is  multiplied  by  p,  we  seek  a solution  of  (3.18)  in  the 
form 

V(x,z,MO  = VQ(x)  +M-V|  (x)z  + pz'V2(x)z  + p.q(x,z,M.) 

= V(x,z,^)  +Hq(x,z,n)  , VQ(0)  = 0 (3.19) 

where 

dq/dx  = 0(1),  dq/dz  = 0(p)  . (3.20) 

We  shall  investigate  the  expansion  of  q in  a later  section.  The  partial 
derivatives  of  V with  respect  to  x,z  are 
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V 


x 

V 


z 


“ V0x  + 0(^ 

= nv[  + 2m.z'V2 


+ 0(H2)  . 


(3.21) 


Substituting  (3.21)  into  (3.18)  and  neglecting  the  p.  dependent  terms,  we 
obtain  the  equation 


° - p + Vi + via2  - * Vi + nB2)R'l<B;vte + Biv 
+ [.'  + 2a'i?2  + VVV'^V  + 


+ z'(Q  + V2A2  + A^V2  - V2B2R_1B^V2)z 


(3.22) 


In  order  to  satisfy  (3.22)  identically  for  all  z,  we  require  that 

vo>-°  <3-23> 

0 = s' +2a^V2 +VQx(A1-B1R'1B^V2) +V[(A2-B2R*1B^V2)  (3.24) 

0 = Q + V2A2+A'V2-V2B2R_1B^V2.  (3.25) 

At  each  fixed  value  of  x,  (3.25)  is  an  algebraic  Riccati  equation  for 

In  view  of  (3.3)  and  Q(x)  > 0,  the  unique  positive  definite  solution  V2 

exists  such  that  for  all  xeD,  the  real  parts  of  the  eigenvalues  of 

A2  = A2~B2R  *B2V2  are  less  than  a negative  constant.  Thus  is  nonsingular 

and  V,  can  be  expressed  in  terms  of  V_  and  V„  as 
1 Ox  2 

V[  = -[s'  + 2a’V2+V0x(A1-B1R-1B^V2)]A21  . (3.26) 

It  is  of  crucial  importance  that  the  elimination  of  from  (3.23)  results 
in  an  equation  involving  only  Vqx.  For  the  well  posedness  of  the  full 
problem  it  is  necessary  that  the  leading  term  Vq  of  (3.19)  be  identical 
to  the  solution  L of  the  reduced  problem. 
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Lemma  3.4.1 

If  Assumptions  (A3. 3)  and  (A3. 4)  are  satisfied,  then  the  unique 
positive  definite  solution  Vg(x)  of  (3.23)-(3.25)  exists  in  D and  is 
identical  to  the  solution  L(x)  of  the  reduced  problem  (3.8),  (3.9). 

Proof:  It  is  shown  in  Appendix  B that  eliminating  from  (3.23),  we 
obtain  the  Hamilton-Jacobi  equation  (3.14)  with  V^x  in  place  of  L^,  and  hence 
Vq(x)  = L(x)  with  properties  as  in  Assumption  (A. 34). 

By  virtue  of  Lemma  3.4.1,  Vq  and  V 2 are  solved  independently  from 
(3.14)  and  (3.25).  This  is  the  separation  of  time  scales  in  the  design  of 
nonlinear  regulators,  analogous  to  our  linear  time -invariant  design  in  [8]. 

Using  V,  we  derive  the  control 

u - - \ R_104v;  + i b’v;> 


- j R-1 [B|Vqx  + B^(Vl  + 2V2z)]  + 0(H) 


(3.27) 


= u£  + 0(h) 


whose  main  part  u£  is  defined  as  the  composite  control.  Eliminating 
from  (3.27)  using  (3.26)  and  following  our  derivation  in  [8],  uc  can  be 
written  as 

uc  ■ b;v)J 


uo(x)-R'1B^V2(z  + A^1a2) 


(3.28) 


where 


Aj (x)  = A2-B2R_1B^V2 

VX>  - a2-J  + B'^)  , I2(0)  - 0. 


(3.29) 


34 


Hence  the  composite  control  uc  consists  of  a slow  control  uq  which  optimizes 
the  reduced  system  (3.8)  and  a fast  control  -R  ^B^V^ (z + A ^a^)  which 
optimizes  the  fast  part  (z+A  ^a^)  of  z in  the  sense  that  V2  satisfies 
(3.25).  Note  that  when  z is  not  penalized  in  (3.2),  that  is  when  Q(x)  *0, 
but  Re{X(A2)}  < 0,  then  \?2  is  identically  zero  and  u£  reduces  to  uq  of  (3.13). 

We  now  apply  the  results  of  Chapter  2 to  investigate  the  stabilizing 
properties  of  uc<  System  (3.1)  controlled  by  uc  is 


x = a^+A^z+BjU^  = a^(x)+A^(x)z  , x(0)=  xq 

M-z  = a2+A2z+B2uc  = a2(x) +A2(x)z,  z(0)=  zq 


(3.30) 


where 


“1  ■ v i • 

Al  = A1-B1R'1B^V2  . 


^(0)  =0 


(3.31) 


After  applying  the  algebraic  manipulation  (2.64)  to  (3.30),  the  resulting 
reduced  system  of  (3.30)  is  identical  to  the  optimally  controlled  reduced 
system  (3.15).  Hence  by  Assumption  (A3. 4),  L is  a Lyapunov  function  for  the 
reduced  system  of  (3.30)  satisfying  Assumption  (A2.3),  and  Theorem  2.3.2 
is  applicable  to  the  full  system  (3.30).  If  Assumption  (A2.4)  is  also 
satisfied,  then  from  Theorem  2.3.1,  the  equilibrium  x = 0,  z = 0 of  (3.30) 
is  asymptotically  stable. 

In  the  case  where  the  fast  transients  of  z in  (3.1)  are  expo- 
nentially stable,  that  is,  A^x)  is  stable  for  all  xeD,  and  we  are  only 
concerned  with  the  optimality  of  the  reduced  system  (3.8),  then  the 
z-independent  reduced  control  uq  of  (3.13)  stabilizes  the  full  system  (3.1) 
with  essentially  the  same  stabilizing  properties  as  u^  of  (3.27).  We  shall 
not  repeat  the  argument. 
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An  attractive  feature  of  the  controls  u and  u is  that  they  do 

co 

not  require  the  knowledge  of  the  actual  value  of  p provided  that  it  is 
sufficiently  small.  When  appropriately  implemented,  these  controls  stabilize 
the  full  system  (3.1)  and  achieve  optimality  of  the  reduced  system,  and  in 
the  case  of  uc>  also  optimality  of  the  fast  part  of  z.  The  above  results 
also  answer  the  question  of  well  posedness  by  giving  the  conditions  under 
which  the  same  optimal  reduced  order  system  is  obtained  with  p set  equal 
to  ze.  either  when  system  (3.1)  is  uncontrolled  or  when  it  is  controlled 
by  u,  or  uq.  In  contrast  to  many  other  singular  perturbation  results  which 
require  p to  be  sufficiently  small,  we  can  also  estimate  the  allowable 
values  of  p given  a stability  domain  or  vice  versa. 


3.5  An  Optimal  Speed  Control  Example 

The  design  procedure  based  on  solving  the  lower  order  equations 
(3.23),  (3.24),  and  (3.25)  for  Vq,  V^,  and  V 2 is  now  applied  to  the  optimal 
control  of  the  DC  motor  (3.1),  (3.6)  with  performance  index 

03 

J = J*  (x2  + z2  + 18000z2  + 5u2  + u2)dt.  (3.32) 

0 

The  reduced  system  of  (3.1),  (3.6)  is 


x = .369x  + .388u^ 

z = -A2 1 (x) (a2 (x)  + B2  u)  = H(x)x  + G(x) u2 


(3.33) 


and  the  reduced  performance  index  is 

® 2 2 2 

J = J [ (1  + H'  QH)x  +2xH'Q&I  +5u  + (l  + G’QG)u2]dt 

o 0 z Z 


(3.34) 
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where  Q * diag(l, 18000) . The  optimal  control  for  this  reduced  problem  is 


u.  = -.0388  V.  (x)  = - .0388  (x)x 
lo  Ox  Ox 

u = -(l  + G'QG)‘1G'QHx 


(3.35) 


where  the  function  Vq^x)  is  plotted  in  Figure  3.1a  for  -50A  < x < 50A. 

Note  that  u^q,  u2q  are  nonlinear  as  Jq  is  not  quadratic.  Since  the  pair 
(Agfc),]^)  of  (3.6)  is  controllable  for  all  x except  at  x = -128.5, 
Assumption  (A3. 2)  is  satisfied  in  a domain  about  x = 0.  As  A2  (x)  of  (3.6) 
is  x-dependent,  the  solution  of  (3.25)  is  also  x-dependent  and  is  plotted 
in  Figure  3.1d-f  for  -50A  < x < 50A,  where 


V9(x)  = _ 


1V2(X)  2V24x) 


2V2 <x)  3V2 


(3.36) 


V^(x)  is  computed  from  (3.26)  and  V^(x)  = V^(x)/x  is  plotted  in  Figures 


3.1b,  3.1c  for  -50A  < x < 50A  where 


Vt(x)  = 


.V,  (x) 


2Vl(x) 


(3.37) 


The  nonlinear  composite  feedback  control  u in  (3.27)  is 


ulc  = -.0388  V0x(x)x 


u2c  = '20*8  1V1(x)x-41.7  1V2(x)z1  - 41.7  2V2(x)z2. 


(3.38) 


A block  diagram  of  this  controller  is  given  in  Figure  3.2.  Applying  our 
technique  in  [8],  the  linear  quadratic  design  of  the  DC  motor  (3.1),  (3.6) 

A 

at  x = 0 results  in  the  same  controllers  U^C>U2C  (3.38)  except  Vqx> 

lV  lV  2^2  are  n0W  fiX6d  at  ^0x(0)  * iV°>’  iV0)’  2^2 (0)-  1C  follows 


U 


DC 


Motor 


40 

from  Corollary  2.3.2  that  x = 0,  z=0  of  the  DC  motor  (3.1),  (3.6)  controlled 
by  (3.38)  is  an  asymptotically  (exponentially)  stable  equilibrium. 

3.6  The  Formal  Expansion 

The  expansion  (3.19)  only  satisfies  the  Hamilton- Jacobi  equation 
(3.18)  to  0(n)  order.  We  now  propose  to  solve  (3.18)  by  expanding  V formally 
as  a nested  infinite  power  series.  If  this  power  series  is  convergent,  then 
the  optimal  solution  V of  (3.18)  exists.  For  x,z  near  the  origin,  it  has 
been  shown  in  [17]  that  the  optimal  solution  exists  and  possesses  a power 
series  expansion  when  system  (3.1)  after  linearization  at  the  origin  is 
stabilizable  and  the  state  in  the  quadratic  approximation  of  J is  observable. 
Here  we  are  interested  in  a power  series  of  V which  satisfies  (3.18)  to  any 
order  of  |i. 

Since  system  (3.1)  is  linear  in  z and  J is  quadratic  in  z,  the 
optimal  value  function  can  be  expanded  as  a power  series  in  the  components 
of  z [18] . In  addition,  since  z is  the  fast  variable,  the  z terms  in  the 
optimal  value  function  are  multiplied  by  appropriate  powers  of  H [5,8].  In 
view  of  these  two  characteristics,  we  seek  a solution  of  (3.18)  in  the  form 

m mm 

V (x,z,h)  = Vq(x,h)+H  2 Vlj(x,H)zj+H  v2 jk(x,H)zjz}c 

+ tl2|i  Ji  ji  W-’^AV- 

m m m 

+ H 2 E ...  2 V..  . . (x,H)z  z ...z  +...  , 

ji=l  j2=i  j.=i  iJ1J2*,,Ji  J1  J2  Ji 


Vq(0,h)  = 0 (3.39) 
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where  V..  . . is  the  (j, element  of  the  completely  symmetric 

1JlJ2*’*Ji  i ^ ^ 1 

generalized  matrix  of  dimension  m and  z^  is  the  jth  component  of  z. 

The  summation  signs  in  (3.39)  and  in  other  equations  will  be  omitted  when 

there  is  no  confusion  as  to  which  indices  j^,j2»  •••>.]£  are  being  summed. 

The  partial  derivatives  V ,V  , ...,V  expressed  in  terms  of  the  vector  x 

X Z , z 

1 m 

and  the  scalars  z,,...,z  are 
1 m 


Vx  V0x  + M'VljxZj  + P’V2jkxZjZk  + **• 


Vz.  ^Vli  + 2M'V2ijZj  + 34  V3ijkzjzk  + *•*’  1 


(3.40) 


where  the  summation  signs  over  j,k  are  omitted. 

For  the  series  (3.39)  to  satisfy  (3.18)  as  an  identity,  we  firsj 

rewrite  (3.18)  in  terms  of  the  vector  x and  the  scalars  z,,...,z  , 

1 m’ 


0 = p + s.zi  + Qijzizj  + Val  + Ali2i>  + - VZi(a2i  + A2ijZ.) 


•7  (VB.  +-V  B-.)R-1(B'V'  + - B'  V ) 

4 v x 1 p 2i'  lx  p 2i  z ^ 


(3.41) 


where  s^,  a^  are  the  ith  components  of  the  vectors  s,  a2,  respectively, 
A.,.,  is  the  ith  column  of  the  matrix  A^,  B2i  is  the  ith  row  of  B0, 


'2'  x2ij 1 


A^j  are  the  (i,j)  elements  of  Q,  A2>  respectively,  and  the  summation  signs 
over  the  indices  i,j  are  omitted.  Then,  upon  substituting  (3.40)  into  (3.41) 
and  equating  the  coefficients  of  the  like  powers  of  z^,  we  obtain 


The  (jifJo j^)  elements  of  V.  are  identical  for  all 

permutations  of  tne  indices  j^,j2>...j^  [31 J. 


T 


° • P + Wl  + Vli*21  ' I <Wl+VllB2i)R'l(BiVi*  + B21Vli>' 


v0(0,u)  = 0 
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(3.42a) 


0 " si  + VOxAli+^Vlixal+VljA2ji  + 2V2ija2j  " 2 (VOxBl 
+ VljB.)R'10xB[V[ix  + 2B^V2j.),  i-l,2,...,m 


(3.42b) 


0 = Qij+^V2ijxai+>i(VlixAlj)s  + 2(V2ikA2kj)s  + 3^V 


3ijka2k 


- I<V0„Bl+VlkB2k>E'1  «*BiVkj*  + *B2kW 

- I (“Vli*Bl  + 2V2ikB2k>B'1  <W>iTij*  + 2B2kV2kJ>  • 


i,j  - 1,2, . . . ,m  (3.42c) 


0 " * V3ijkxal+,llV2ijxAlk)s  + ^ V4ijkqa2q  + 3ll<V31jqA2qk)s 

• i <V0*Bl  + ''l,B2,)R'1 

■!WuA*W'‘  + • 

i,  j ,k  = 1,2 m (3.42d)2 


ZThe  subscript  s denotes  the  symmetrization  operation  of  generalized 
matrices  [31].  For  example, 

^V2ikA2kj^ s = 2 ^ik^kj  + V2  jkA2kP 

(V3i jqA2 qk} s " 6 (V3ijqA2qk+V3jiqA2qk+V3ikqA2qj+V3kiqA2qj+V3jkqA2qi+V3kjqA2qi) * 


iL- 
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n 


L 


kj 


where  the  right  hand  sides  of  (3.42a),  (3.42b),  (3.42c),  (3.42d),...,  are 


the  coefficients  of  the  z-independent  terms  and  of  the  z^,  z^zy  z±zjzk’“’’ 


terms,  respectively.  Because  of  symmetry,  there  are  m(m+l)/2  equations 

i-1 

in  (3.42c),  m(m+ 1)  (m  + 2)/6  equations  in  (3.42d)  and  in  general,  ( rr  (m  + k))/i! 

k=0 

equations  when  the  coefficients  of  z.  z.  ...z,  , j.  ,j9,. .., j.  = l,2,...,m, 

J1  J2  Ji  1 z 1 

are  equated. 


For  a simplified  treatment  of  these  equations  we  now  exploit  the 
presence  of  the  small  singular  perturbation  parameter  |A.  We  expand  each 
coefficient  of  (3.39)  as  a power  series  in  M> 


V,(x,p.)  *E^v](x)  , i = 0,1,2, . . . 

j=0 


(3.43) 


where  the  boundary  condition  of  Vq  is  Vq(0)  = 0,  j =0,1,2,...  The 
expressions  (3.43)  substituted  into  equations  (3.42)  are  to  satisfy  them 
as  identities  in  |i.  Equating  the  coefficients  of  the  like  powers  in  M>,  we 


generate  sets  of  equations  for  V^,  i, j = 0, 1,2, . . . The  first  set  of  equations 


obtained  by  equating  the  p.- independent  parts  in  (3.42a),  (3.42b),  (3.42c), 
are  precisely  equations  (3.23),  (3.24),  (3.25),  respectively.  Hence  from  the 
uniqueness  of  solutions  to  (3.23),  (3.24),  (3.25),  we  conclude  that 


V®  = V 
v0  v0 


L,  Vj-Vj, 


V°  = V 
2 v2 


(3.44) 


and  V thus  consists  of  the  leading  terms  of  V. 

The  second  set  of  equations  in  matrix  form 


0 - vL*i + vi'v  vo<°>  ■ ° 


0 ■ Wl  + “iV?K  + ?rA2  + 2»2V2 


(3.45a) 

(3.45b) 


0 -(''“x*!*  7 + 3iVU>  + Vk  + 32V2  + 3(V5S2)  (3-45c) 

0 ■ 3(V3I2>S  + <V2*I1)S  <3’4M> 


obtained  by  equating  the  p.  terms  in  (3.42a),  (3.42b),  (3.42c),  (3.42d), 
respectively,  involve  only  the  unknown  terms  V^,  V^,  and  V^-  In  (3.45) 
the  multiplication  of  an  n^Xn^Xn^  matrix  by  an  n^Xn^  matrix  results  in  an 
n^X^Xn^  matrix.  For  convenience  we  suppress  the  last  dimension  of  the 
mXmXl  matrices  (V^a^)  and  (V^a2 ) an<*  regard  them  as  mXm  matrices. 

In  general,  in  equating  the  p.1-  terms  we  obtain  the  (i+l)st  set 
of  equations  involving  the  terms  Vqx>  V^,  V^,  V?+2-  The  main 

accomplishment  of  the  nested  expansions  is  that  the  first  set  of  equations 
(3.23),  (3.24),  (3.25)  can  be  solved  independently  for  the  first  three 
zeroth  order  terms  Vq,  V^  and  V^.  Similarly,  (3.45)  and  the  subsequent 
sets  of  equations  can  be  solved  independently  for  Vq,  V^,...,  V*?+2* 


3.7  Coefficients  of  Higher  Order  Expansions 

After  V^,  V?  and  V 2 are  obtained,  we  proceed  to  solve  for 
Vqx>  vj,  and  V^  in  (3.45).  The  following  result  is  needed. 

Lenina  3.7.1:  [18] 

If  Re{\(A2)}  < a for  a fixed  a < 0 and  X is  a completely  symmetric 
k lc 

mXmX  ...  Xm=m  matrix,  then  the  unique  m matrix  solution  Y of  the  equation 


<™2>s 


(3.46) 


exists  and  is  completely  symmetric. 

Thus  by  Lemma  3.7.1,  the  unique  completely  symmetric  mXmXm  matrix 
solution  V3°  of  (3.45d)  exists.  After  obtaining  V^,  we  solve  for  the  unique 
symmetric  mXm  matrix  solution  V^  of  (3.45c).  Since  and  V2  are  known, 
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in  (3.45b)  can  be  rewritten  as 


V1  “ ‘ f(VOx^l  + alVlx  + 2a2V2)A2 


(3.47) 


Elimination  of  from  (3.45a)  yields 


0 = vi__a_  - aiV?.'^1^  - »A(vJa2’1  + S^V*)  a2  (3*48) 


Ox  o 1 lx  2 2 2 


by  using  the  relation  aQ  * a^  - ^"a^.  Premultiplying  (3.45c)  by  5^  ^ 


and  postmultip lying  by  we  obtain 


A,’1(V°  a )~K  + — A'”1(V°  A + A'V°')A  -1 

A2  lv2x  1,A2  22  tVlx  1 AlVlx;  2 

+ 3 A^_1(V^2)A2"1  = - (V2A2_1  + A^_1V2). 


(3.49) 


Substituting  (3.49)  into  (3.48)  and  rearranging,  (3.48)  becomes 

° ■ vL;o  - ^rlv?A + si5rl'<vL*i)  + wSviv1^ 


(3.50) 


We  now  rewrite  (3.45d)  in  scalar  form 


V-  . . A„  . + V~ . . A_  . + V°  . , A„  , + 
3ijq  2qk  3iqk  2qj  3qjk  2qi 


— (V^*  A + A.  . + V?.,  A,.) 

3 ^ 2ijx  lk  2ikx  lj  2jkx  li' 


(3.31) 


,T  -It 


Then  multiplying  the  expression  (3.51)  by  (A2  a^,  ^ a2^j’  ^A2  a2^k 

and  summing  over  the  indices  i,j,k,  we  obtain 


46 


[V3ijq^2qk  + V3iqkA2qj  + V3qjAqi  + 

+ 3(V2ijxAlk  + V2ikxAlj +V2jkxAli)]  (A2  a2^i(A2  a2JJ(A2  *l\ 

[V3ijqa2q  + 3 V2ijxAlA2  a2^(A2  a2*i(A  a2^j 
+ fV3ikqa2q  + 3 V2ikxAlA2  a2J(A2  a2Ji^2  a2^k 

+ ^V3jkqa2q  + 3 ^jkx^l^  a2^  (A2  a2^j(A2  a2^k  = 0 (3-52) 

where  the  s unmat ion  signs  of  the  indices  i,  j,  and  k are  omitted.  Expression 
(3.52)  in  matrix  form  is 


(VSp'130'*)  + (V2*AlA2'la2))(Vla2)  ■ °- 


(3.53) 


0-r  , 


Using  (3.53)  to  eliminate  the  terra  ( V^a in  (3.50),  we  obtain  the  first  order 
linear  partial  differential  equation 


VLao  • WVs.  + a2A2_l  (VLa0)A2'la2 


* VL‘°  * £<a2'A2'VL-V2°K>Io  * 0 > 


vj(0)  = 0. 


(3.54) 


To  guarantee  the  existence  of  the  solution  Vq  of  (3.54),  the 
stability  condition  for  the  reduced  system  (3.15)  is  restated  as: 


(A3. 5)  The  trajectories  g(t)  of  (3.15)  for  all  g(0)  = xq  e D satisfy 


J |dg|  =*  J |g(t)|dt  < » 


(3.55) 


that  is,  their  lengths  are  finite. 

One  case  in  which  Assumption  (A3. 5)  is  clearly  satisfied  is  when  x = 0 is 
an  exponentially  stable  equilibrium  of  the  reduced  system  (3.15).  Certain 
nonlinear  systems  whose  equilibria  are  only  asymptotically  stable  also 
satisfy  this  condition. 
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We  now  show  the  existence  of  the  solution  of  Vq  of  (3.54)  in  the 


following  lemma. 


Lenma  3.7.2 


If  Assumption  (A3. 5)  is  satisfied,  then  the  unique  bounded  solution 
Vq(x)  with  Vq(0)  = 0 of  (3.54)  exists  for  all  x6D. 

Proof:  The  partial  differential  equation  (3.54)  can  be  expressed  as  a set 
of  ordinary  differential  equations  [32] 


x = a (x) 
o 


, x(0)  = x 


V*  = f(a2(x),A2(x),V°x(x),V2x(x))ao(x),  vj(0)  = 0 . 


(3.56a) 


(3.56b) 


Assumption  (A3. 4)  implies  that  the  trajectory  g(t)  of  (3.56a)  with  § (0)  = 
x^eD  is  contained  in  D and  §(“)  = 0.  Thus  Vq(xq)  is  determined  by 

00 

vj(0)  - vj(x0)  = J f(a2(5(t)),A2(g(t)),vJx(g(t)),v2x(5(t)))I0(5(t))dt 


- J f(^(5),A2(g),v5x(g),v2x(g))  dg 


(3.57) 


where  f is  the  trajectory  of  g(t).  Imposing  the  end  condition  Vq(0)  = 0, 


(3.57)  becomes 


TJ<s>  - -I  f<vvv!*-v2*>« 


(3.58) 


Thus  (3.58)  is  the  unique  solution  to  (3.54)  as 


|vJ(xQ)|  < |f|  J |dg| 


(3.59) 


which  follows  from  Assumption  (A3. 5)  and  the  boundedness  of  f in  D. 


J 
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Similarly,  the  solution  of  the  other  coefficients  of  V in  the  kth 
set  of  equations  can  be  obtained.  Let  V be  the  series  solution  of  V to 
(3.39),  (3.43)  incorporating  all  the  coefficients  of  V up  to  the  kth  set 
of  equations  of  V,  and  let 

uk  = '2R'1(Brf  +Jb;{).  (3.60) 

We  sumnarize  the  above  discussion  as  follows. 

Theorem  3.7.1 

If  Assumptions  (A3. 1)- (A3. 5)  are  satisfied,  then  the  unique  series 
expansions  of  V and  u exist  for  all  finite  k.  Furthermore,  V satisfies 

k 

the  Hamilton- Jacobi  equation  (3.18)  to  an  0((i  ) error. 

' 

Proof : Assumptions  (A3. 1)- (A3. 5)  imply  that  for  all  finite  k,  the  coefficients 

of  V up  to  the  kth  set  of  equations  of  V can  be  uniquely  solved  for  as 

k k 

* bounded  functions  of  xeD.  Thus  the  unique  series  expansions  of  V and  u 

• 

exist.  If  V is  substituted  in  (3.41),  the  Hamilton- Jacobi  equation  (3.41) 
is  satisfied  to  0 (|j,  ),  implying  the  second  conclusion  of  the  theorem. 

Repeating  the  derivation  in  Section  2.3,  we  can  show  that  u 
stabilizes  the  full  system  (3.1)  with  similar  stabilizing  properties  as  uc 
of  (3.27).  We  first  introduce  the  x,  T]  = z + variables  and  consider 

U in>  (2.26)  as  a tentative  Lyapunov  function.  The  analysis  is  more  cumber- 
some but  results  similar  to  Theorems  2.3.1  and  2.3.2  and  Corollaries  2.3.1 
and  2.3.2  can  be  established. 

3.8  Approximations  of  the  Performance  Value  Function 

We  now  investigate  the  performance  of  the  full  system  (3.1) 
controlled  by  a truncated  series  of  the  minimizing  control  u of  (3.17). 

Consider  the  composite  control  u£  of  (3.27)  which  is  obtained  from  u of 

fchjl  u 


(3.61) 


r. 

r. 

o 

o 


o 

0 

D 


0 

0 


l! 


D 


Lk 


(3.17)  by  neglecting  all  the  0(H)  terms.  System  (3.1)  controlled  by  u 


becomes 


x = a,x  + A,z  + B..U  = a.x  + A,z 
1 1 1 c 1 1 


Hz  = a2x  + k^z  + B2uc  = a2x  + K^z 


The  performance  U(x,z,H)  of  (3.61)  satisfies  the  partial  differential  equation 

p + s 'z  + z'Qz +u'Ru  +U  (a, +A..Z +B.u  ) +—  U (a_+A0z+B_u  ) = 0, 
ccx  ll  1 c H z 2 2 2 c 


U(0,0,h)  - 0, 


(3.62) 


that  is 


P+s'z  + z'Qz+j  [vJJ^  + (V?  + 2V°z)  'B,  ]R_  1 [Bj  + B^  (V°  + 2V°z)  ] 


+ Ux(a1  + A1z)+i  Uz(a2  + A2z)  = 0. 


(3.63) 


Similar  to  V,  U can  be  expanded  as  a nested  power  series  of  h and  z 


U * Uq(x,h)  + HU|(x,h)z  +Hz'U2(x,H)z+HZU3ijk(x,H)zizjzk  + ... 

00 

u (x,H)  * £ hV(x),  q=0,l,2,... 
q i=0  q 

subject  to  uj(0)  * 0,  i»0,l,2,...  Following  the  procedure  to  find  the 
coefficients  of  the  series  expansion  V,  we  substitute  (3.64)  into  (3.63) 
and  equate  the  resulting  ^-independent  terms  to  obtain 

p+i  <vteBitv?'B2>R'1(B;vfe+Biv!>+uSx*i+u?'';2  ■ °-  uo<o)-° 
s’  + (V0*B1  + Vi'B2)R'1b2V2  + U0*X1  + "i'I2  + 2I2O2  * 0 


(3.64) 


(3.65) 


Q + V°  b2R"1B^V2  H-U^  +A^U°  = 0 

which  are  the  coefficients  of  the  z- independent , z^,  z^z^  terms,  respectively. 
However,  equations  (3.65)  can  be  rearranged  into  the  form  of  (3.23),  (3.24), 
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(3.25)  with  U^,  U®,  and  U°  replacing  VQx>  V2>  respectively.  Then 
from  the  uniqueness  of  solution  of  (3.23),  (3.24),  (3.25),  and  from  (3.44) 


U0  * V0*  U1  = Vl»  U2  = V2  * 


(3.66) 


Equating  the  (A  terms  in  (3.63),  we  obtain  the  equations 

°L*i + DiX  ■ 0 • °J<0)  ■ 0 


Vu  + °0x4l  + ^1*2  + 2a2U2  ■ 0 


<"LV  + 2 W?x4l  + A;U?x>  + <°242  + *iU2l>  + 3<°fe>  " ° 


(3.67) 


<U2xVS  + 3<USVs  ■ ° • 


Comparing  these  equations  to  (3.45),  it  is  obvious  that 


U0  = V0>  U1  = Vl*  U2  = V2’  U3  = V3  * 


(3.68) 


The  other  coefficients  in  the  expansion  of  U can  also  be  obtained 
sequentially  and  the  procedure  is  similar  to  that  of  solving  for  V.  Let 
U be  the  performance  of  (3.61)  incorporating  the  coefficients  of  U up  to 
the  kth  set  of  equations  of  U. 

Theorem  3.8,1 

If  Assumptions  (A3. 1)- (A3. 5)  are  satisfied,  then  the  unique  series 

expansion  of  the  performance  U of  the  full  system  (3.1)  controlled  by 

k 2 

of  (3.27)  exists  for  all  finite  k and  matches  the  expansion  V to  0(H  ), 


that  is, 


Uk(x,z,n)  - V1*  (x,z,p.)  = 0 (m.2 ) , k > 2. 


(3.69) 
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The  proof  of  Theorem  3.8.1  follows  immediately  from  (3.66),  (3.68) 

2 

and  Lemma  3.72.  Although  U£  is  independent  of  p.,  it  is  an  0(|i  ) near- 
optimal  control  in  the  sense  of  (3.69).  It  is  also  applicable  when  p,  is 
small  but  uncertain. 

In  the  special  case  where  Re{^-(A2(x))}  < 0 for  all  xeD,  the 
optimal  control  uq  of  the  reduced  problem  (3.8),  (3.9)  can  be  applied  to 
(3.1).  Then  the  feedback  system  is 

x = a1+Al«+BlUo  = a1-B1R;1(so  ^B^+V 

Hz  = a2  + A2z+B2uo  = a2-B2R;1(so+  J B^)  + A^z  . 

The  performance  Y(x,z,p.)  of  (3.70)  also  possesses  a series  expansion  of 
the  form  (3.64)  and  satisfies  the  partial  differential  equation 


(3.70) 


i ' 


p + s'z  + z'Qz  + u'Ru  + Y (a.+A.z+B.u  )+—  Y (a„  + A0z  +B~u  ) = 0.  (3.71) 

r H oox  ll  1 o'  p.  z 2 2 2 o' 


Following  [8],  we  rewrite  (3.13)  as 

1-1  0 1 ~ 
T R (B,’V„._  + BlV 


"o*-2K  <BiV0*+W 


where 


’l  * f V V2<A2-B28'1b2V2)'1b2R‘1b2  1 [Vl  + 2V2 ^ 1 (a2 -B2R’ 1 


and  obtain  the  difference  between  u and  u as 

o c 


Uc  “ Uo  = " I R’1b1<V?  • V+R^BjvJz  . 


Then  subtracting  (3.71)  from  (3.63)  and  expanding  W = Y-U  as  a series 
expansion  in  p.  and  z,  we  equate  the  P>- independent  terms  to  obtain 


(3.72) 


(3.73) 


(3.74) 


V'l(I‘lvte+Bi?i>1+B?,‘a2--i  B2E'l(BiVta+B25l>i 

+ 4 (vJ-VV^X'V  = ° * W0(0)  = ° 


(3.75a) 


W0xAl+WlA2+2[a2  ’ 2 B2R"1(BiV0^  + B2^1)]'W2  ' (V1  ' V - 0 (3.75b) 


W2A2  + *2^2  + V2B2R"1b2V2  = 0 


(3.75c) 


which  are  the  coefficients  of  z- independent,  z^,  z^z^  terms,  respectively. 

If  RefX^)}  < 0,  the  positive  semidefinite  solution  of  (3.75c) 
exists.  Solving  for  in  terms  of  and  from  (3.75b)  and  substituting 


into  (3.75a)  yield 


wta'ao  - VoI(so + h B;vto»  ■ nb2r'1bin-  ■ u2<°)  ■ ° 


(3.76) 


where 


»-£  <vrV  • 'a2-iB2B'l<Blvte+B2VI,Ai‘lv?  • <3-77> 


But  N = 0 due  to  (3.73),  and  hence  - 0 and  Wq  s 0.  Thus 

Y°  = V° 

*0  V0  • 


(3.78) 


The  procedure  of  solving  for  other  coefficients  in  the  expansion 
Y is  similar  to  that  of  solving  for  those  in  V.  Let  Y be  the  performance 
of  (3.70)  incorporating  the  coefficients  of  Y up  to  the  kth  set  of  equations 
of  Y.  The  above  results  are  summarized  in  the  following  theorem. 

Theorem  3.8.2 

If  Assumptions  (A3.1),  (A3. 2)  and  (A3. 4)  are  satisfied  and 
Re{\(A2)}  < 0,  then  the  unique  series  expansion  of  the  performance  Y of 
the  full  system  (3.1)  controlled  by  the  reduced  control  uq  of  (3.13)  exists 
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for  all  finite  k and  matches  Vk  to  0(p.),  that  is 

Yk(x,z,n)  - Ax.z  ,H)  = OGi)  , k > 1.  (3.79) 

From  Theorem  3.8.2,  uq  is  an  0(H)  near-optimal  control  in  the  sense 
of  (3.79).  Since  it  is  also  independent  of  p>,  it  can  be  applied  when  p.  is 
small  but  uncertain. 

3.9  Discussion 

The  nonlinear  composite  feedback  control  proposed  in  this  chapter 
is  composed  of  a fast  part  optimizing  and  stabilizing  the  fast  transients 
and  a reduced  control  representing  the  solution  of  the  reduced  order  opti- 
mization problem.  Conditions  under  which  this  composite  control  exists  and 

stabilizes  the  full  system  are  simple  to  check.  It  is  shown  that  this  control 
2 

is  0(ji  ) near-optimal.  The  series  expansion  method  for  higher  order  expan- 
sions is  outlined.  A crucial  property  of  the  analytical  relationship  and 
design  computations  is  that  they  all  appear  in  separate  time  scales.  Thus 
the  proposed  design  procedure  is  applicable  to  large  scale  systems.  The 
resulting  feedback  control  also  has  the  two-time-scale  structure  where  the 
slow  variables  are  used  for  the  slow  feedback  part  and  appear  as  slowly 
adjusted  parameters  in  the  fast  feedback  part.  As  a simple  illustration  of 
this  control  scheme,  a DC  motor  control  by  both  armature  and  field  voltages 
is  designed.  The  field  phenomenon  being  much  slower  than  the  mechanical 
and  armature  transients  appears  in  the  reduced  problem,  while  the  armature 
control  obtained  as  a result  of  the  fast  problem  involves  the  field  variables 
as  slowly  varying  parameters. 
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4.  NONLINEAR  FIXED  ENDPOINT  PROBLEM 

4.1  Introduction 

In  Chapter  3 we  have  considered  the  regulator  problem  for  the  non- 
linear system  (3.1).  In  this  chapter,  we  consider  fixed  endpoint  problem 
of  minimizing  the  performance  index 
T 

J - J [VjCx.t.p.) +V2‘ (x,t,p.)z  + z'V3(x,t,|J.)z +u'R(x,t,M.)u]dt 
0 

T 

= J [V(x,z,t,p.)  + u'R(x,t,pi)u]dt  (4.1) 

0 

subject  to  the  nonlinear  dynamics 

* a1(x,t,p.)  + A1(x,t,|J.)z +B1(x,t,M.)u,  x(0,p.)  - XQ(p,)  ,x(T,p.)  = x^p,) 

(4.2a) 

p.  ^jr  = a2(x,t,p,)  +A2(x,t,|x)z  +B2(x,t,p.)u,  z(0,p.)  = ZQ(p ) ,z  (T.p.)  = zT(P-) 

(4.2b) 

where  the  states  are  xeRn  and  z£Rm,  the  control  is  ueRr,  p is  a small 
parameter  and  the  prime  denotes  transposition.  We  assume  that  the  matrices 
V3  and  R are  positive  definite  in  x and  V is  a positive  definite  function  of 
x and  z.  Furthermore,  we  assume  that  a^,  A^,  B^,  xq,  x^,,  zq,  V and  R 
have  asymptotic  power  series  expansions  as  p.  -*  0 with  infinitely  differentiable 
coefficients.  In  addition,  A2  is  assumed  to  be  nonsingular.  The  Hamiltonian 
for  problem  (4.1),  (4.2)  is 

H(x,z,u,p,q,t,p.)  = V + p' (a^Aj^z+B^u) +q'(a2+A2z+B2u)  +u'Ru  (4.3) 
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where  the  costates  p and  p.q  satisfy  the  equations 


3t  = 

M-  = -VzH(x,z,u,p,q,t,n) 


The  control  which  solves 


= 2Ru  + B|p  + B^q  = 0 


is  the  minimizing  control 


u = - \ R~L (B|p  + B^q)  . 


(4.4a) 


(4.4b) 


(4.5) 


(4.6) 


The  substitution  of  (4.6)  into  (4.2)  and  (4.4)  yields  a nonlinear  two-point- 
boundary- value  (TPBV)  problem 

dx/dt  = a1  + A1z-~  BjR*1  (Bjp  + B^q)  s g^x.p.z.q.n.t) 

dp/dt  = -7  H(x,z,-tR  1(B1'p +B'q)  ,p,q,t,M,)  s g (x,p,z,q,|J.,t) 

X Z 1 1 (4.7a) 

M-dz/dt  = a2  +^z  -j  B2R’1(B[p + B^q)  s g3  (x,p,z,q,p,,t) 
p,dq/dt  = -V2  - 2V^z  - Ajp  - A^q  = g4  (x,p  ,z , q,|i  , t) 
where  the  boundary  conditions  are 

x(0,p.)  - XQ(p),  x(T.M-)  = 3^01),  z (0,p.)  = zq(M'),  z (T,p>)  = zT(p.)  . (4.7b) 

Optimal  control  problems  of  the  type  (4.1),  (4.2)  with  free  end- 
points are  treated  in  [14-16],  while  more  general  free  endpoint  problems 
are  considered  in  [33-35].  Fixed  endpoint  problem  has  been  treated  in  [7] 
where  (4.1)  is  in  quadratic  form  and  (4.2)  is  linear.  For  the  nonlinear 
fixed  endpoint  problem,  our  approach  is  to  decompose  the  full  problem  (4.1), 
(4.2)  into  three  separate  lower  order  problems,  an  n-dimensional  nonlinear 
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"reduced"  problem  and  two  m- dimensional  linear  quadratic  "boundary  layer" 
problems.  Thus  the  technique  in  [7]  for  linear  quadratic  problems  is 
now  extended  to  nonlinear  problems.  A further  result  is  that  our  formu- 
lation of  the  reduced  problem  is  particularly  simple.  Then  similar  to  the 
results  in  [14-16,35]  a solution  x,z,p,q,u  to  the  full  TPBV  problem  (7) 
is  shown  to  possess  an  asymptotic  series  expansion  in  H and  is  approxi- 
mated to  OQa)  by  combining  the  solutions  to  the  reduced  problem  and  the 
boundary  layer  problems.  For  practical  implementation,  we  propose  a 
partially  closed-loop  control  to  achieve  stability  of  the  fast  variable  z. 

4.2  Lower  Order  Problems 

Due  to  the  presence  of  |J.,  system  (4.2)  possesses  a two-time-scale 
property,  that  is  the  variable  x varies  slowly  while  the  variable  z has  a 
rapidly  varying  part.  Letting  |i  = 0 in  (4.2),  which  is  equivalent  to 
neglecting  the  fast  part  in  z,  we  obtain 

^ = a1+A1z  + B1u,  x(0)=xq(0),  x(T)=xT(0)  (4.8a) 

0 = + k^z  + B^u  . (4.8b) 

Here  and  in  the  following,  an  overbar  indicates  that  H = 0.  Assuming  that 
A£  is  nonsingular,  the  slow  part  z of  z is  solved  from  (4.8b)  as 

2 = -A^  ^(a^+B^u)  . (4.9) 

Eliminating  ~z  from  (4.8a)  and  the  performance  function  (4.1)  evaluated  at 
= 0,  we  define  the  reduced  problem  as  follows. 

Reduced  Prolem:  The  reduced  problem  is  to  minimize  the  performance  index 

T 

J = J [L^^CXjt)  +21^  (x,t)u  + u'L3(x,t)u]dt 
0 


(4.10) 
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subject  to 

dx/dt  = a(x,t)  + B(x,t)u  , x(0)  = xq(0),  X(T)  = ^(0)  (4.11) 

where  , , 

L1  = Vl‘V2A2  a2  + a2A2  V3A2  a2 

L2  = ®S’1(¥2*1“2  ” 2 V 

L3  = R + (4.12) 

- _ “ T T -1— 

3 3^  “ A^2 

I = Bx  - V2 ~ 1B2  . 


The  Hamiltonian  of  the  reduced  problem  is 

H(x,p,u,t)  = Ll  + 2L2u  +u'L3u  + p'  (a  + BO)  (4.13) 

where  the  costate  p satisfies 

dp/dt  - -7_H0c,p,u,t)  . (4.14) 

x 

The  control  which  solves 

&H/bu  - 2L2  + 2L3u  + B’p  = 0 (4.15) 

is  the  minimizing  control 

u - - | L3L(2L2  + B' p)  . (4.16) 

Substitution  of  (4.16)  into  (4.11)  and  (4.14)  results  in  the  reduced  TPBV 
problem 

dx/dt  - a-^Lj1^  - j iL^I'p  ■ f1(x,p,t),  x(0)-xq(0),  x(T)=xt(0)  (4.17a) 

dp/dt  - -V_H(x,?,-iL31(2L2+B'?),t)  * f2(x,p,t)  . (4.17b) 

The  following  assumption  is  crucial. 
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(A4.1)  The  reduced  TPBV  problem  (4.17)  has  a unique  solution  x*(t),p*(t) 
and  u*(t)  for  all  t e [0,T]. 

Linearizing  (4.17)  along  x*,p*,  we  obtain  the  variational 
equation  as 


- 

* 

- 

r 

- 

- 

* — 

d 

6x 

flx 

fip 

6x 

ci 

•C2 

6x 

dt 

6p 

f2x 

f2? 

6p 

“C3 

-Ci 

6p 

. 

- 

- 

_ 

_ 

(4.18) 


System  (4.18)  is  assumed  to  satisfy  the  following  assumption. 

(A4.2)  is  positive  semidefinite  along  x*,p*. 

Assumption  (A4.2)  rules  out  the  occurrence  of  conjugate  points  [36]  and 
guarantees  that  x*,p*  yield  a local  minimum.  This  assumption  is  also  crucial 
for  finding  higher  order  terms  in  the  asymptotic  series  expansions  for 


x,z,p,q,u  of  (4.6),  (4.7). 


Since  z*  in  general  does  not  satisfy  the  end  conditions  (4.2b),  we 
assume  that  the  variable  z contains  an  initial  (left)  boundary  layer  \(t) 
and  an  end  (right)  boundary  layer  P (a)  such  that 

z(t)  = z*(t)  + \(t)  + P(P)  (4.19) 

where  T = t/M-  and  a = (t-T)/^  are  the  "stretched"  time  scales.  Substituting 
(4.19)  into  (4.2b)  and  equating  the  layer  terms,  we  obtain  the  boundary 
layer  systems  as 

- A2(0)X(t)  + B2 (0)1^00  , \(0) -zo(0)-7*(0)  (4.20) 

= ^(T)p(ff)  + B2(T)up(r)  , p(0) -zt(0)-z*(T)  (4.21) 

where  u is  also  decomposed  into 


u(t)  =*  u*(t)  + u^(T)  + up  (a)  . 


(4.22) 
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Substituting  (4.19)  and  (4.22)  into  (4.1)  and  retaining  only  the  quadratic 
terms  in  p,  u^,  up,  we  define  the  boundary  layer  problems  as  follows. 
Boundary  Layer  Problems:  The  left  boundary  layer  problem  (LBLP)  is  to 
minimize 

00 

Jx  = J [\'V3(0)\  + u{R(0)ux]dT  (4.23) 

0 

subject  to  the  dynamics  (4.20).  The  right  boundary  layer  problem  (RBLP)  is 
to  minimize 

0 

Jp  = J [P’V3(T)P  + ujR(T)up]dp  (4.24) 

subject  to  the  dynamics  (4.21). 

We  now  make  the  following  assumption. 

(A4.3)  For  all  t e [0,T]  and  along  the  trajectory  x* 

rank[B2>A2B2> . . . ,A2m  = m 

rank  (H^ , A£h£  , . .•  ,A^m"  ^ ] = m 

where  H2  satisfies  H2H2  = V^. 

Under  Assumption  (A4.3),  the  solutions  to  LBLP  and  RBLP  exist  and  are  given  by 


u^(T)  = -R_1(0)B^(0)Kx(0)\(T) 

(4.25) 

— i 

u (ff)  = -R  (T)B^  (T)Kp(T)p(a) 

(4.26) 

where  K^(0)  is  the  positive  definite  solution  and  Kp (T)  is  the  negative 
definite  solution  of 

KA2  + A K - KB2 R~ 1 B2 K + = 0 (4.27) 

at  t * 0 and  t = T respectively. 
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4.3  Main  Theorem 

The  decomposition  of  the  full  problem  (4.1),  (4.2)  into  the  reduced 
problem  and  two  boundary  layer  problems  is  justified  in  the  following  theorem. 
Theorem  4.3.1 

If  Assumptions  (A4. 1)- (A4.3)  hold,  then  there  exists  a |i*  > 0 such 
that  for  all  p e (0,p*] , an  asymptotic  series  solution  x*,  z*,  p*,  q*,  u*  to 
(4.6),  (4.7)  exists  and  is  approximated  to  0(p)  by  the  solution  of  the 
reduced  problem  and  the  boundary  layer  problems  as 


x*(t,p) 

= x*(t) 

+ 

0(p) 

(4.28a) 

Z*(t,p) 

= z*(t) 

+ 

Mt)  + P(ff)  + 0(P) 

(4.28b) 

p*(t,p) 

ii 

/-N 

rt 

+ 

0(p) 

(4.28c) 

q*^) 

- -*rl 

(v. 

2+2V3z*+A^p*)  + 2K^  (0)\  (T)+2Kp  (T)p(CT)+0(P) 

(4.28d) 

u*(t,p) 

= u*(t) 

+ 

ux(T)  + up  (a)  + 0(p)  . 

(4.28e) 

The  meaning  of  this  theorem  is  that  we  can  obtain  an  0(p)  approxi- 
mate solution  to  the  full  TPBV  problem  (4.6),  (4.7)  by  solving  for  the  reduced 
problem,  the  LBLP  and  the  RBLP.  The  reduced  problem  is  of  lower  order  and 
does  not  involve  the  small  parameter  p.  Thus  we  can  use  large  stepsizes  in 
the  numerical  computation  of  the  reduced  problem.  The  LBLP  and  the  RBLP  are 
linear  quadratic  problems  and  their  computation  is  a small  fraction  of  the 
time  required  to  compute  nonlinear  problems  of  the  same  dimension.  Thus 
solving  for  the  lower  dimension  problems  results  in  considerable  savings  of 
computation  time. 

In  the  actual  implementation  of  the  control  (4.22)  to  the  physical 
system  (4.2),  undesirable  behavior  will  occur  if  A.,  is  unstable.  Since  u(t) 
of  (4.22)  is  an  open-loop  control,  it  does  not  affect  the  stability  of  the 
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system  (4.2).  Hence  if  A2  is  unstable,  the  higher  order  (j.  terms  in  (4.28) 

1/M* 

which  are  not  compensated  will  grow  as  0(e  ).  Furthermore,  the  error 

increases  as  p,  decreases.  An  example  illustrating  this  behavior  in  linear 
time-varying  system  is  given  in  [7],  This  problem  can  be  avoided  by  using 
a partially  closed- loop  control. 

u = M(x(t) ,t)z  + v (4.29) 

such  that  (A^  + B2M)  is  stable  along  the  trajectory  x*.  Assumption  (A4.3) 
guarantees  that  such  an  M exists  and  can  be  computed  as 

M = -F^KOO  (4.30) 

where  K(t)  is  the  positive  definite  solution  to  (4.27)  for  te  [0,T].  Then 
the  open- loop  control  v is  computed  as 

v = u - Mz  . (4.31) 


4.4  Example 

We  consider  the  optimal  control  of  the  system 

x = xz  , x(0)  = l/*/2  , x(l)  = .5 

M-z  = -z+u,  z(0)  = 0 , z(l)  = 0 

with  respect  to  the  performance  function 

J * J (x4  + j z2  + j u2)dt  . 

0 

The  Hamiltonian  for  (4.32),  (4.33)  is 

4 12  12 

H = x + YZ  + J ' + P(xz)  + q(-z+u) 


(4.32) 


(4.33) 


(4.34) 
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and  the  minimizing  control  is 


u = -q 


(4.35) 


as  dH/du  = u + q = 0.  Thus  the  TPBV  problem  is 


|j.z  = -z-q 


(4.36) 


p = -dH/dx  = -4x-pz 
p.q  = -SH/Sz  « -px-z+q  . 

We  now  apply  the  decomposition  procedure  to  obtain  0(p.)  approximations  of 


x,z,p,q,u. 


The  reduced  problem  of  (4.32),  (4.33)  is  to  optimally  control  the 


reduced  system 


x * xu,  x(0)  = l/V?  , x(l)  = .5 


(4.37) 


with  respect  to 


03 

J = J (£^  + U2)dt  . 


(4.38) 


The  Hamiltonian  for  this  reduced  problem  is 


- -U  _2  

H = x + u +pxu 


(4.39) 


and  the  reduced  control  u satisfies 


dH/du  = 2u  + p x =0 


(4.40) 


that  is , 


u = -px/2  . 


(4.41) 
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The  reduced  TPBV  problem  becomes 


x * -x2p/2  , x(0)  = 1/V2  , x(l)  = .5 

p = -3h/3x  = -4x^-pu  = -4x^  + xp2  /2 


(4.42) 


The  unique  solution  to  (4.42)  is  found  analytically  to  be 

x*(t)  = l/v/2(t  + l) 


p*(t)  = 2x*(t)  * «/2/ (t  + 1) 


(4.43) 


u*(t)  = -x*  (t)  = -1/ (2 (t  + 1) ) 


z*(t)  = u*(t) 


Linearization  of  (4.43)  along  x*,p*  reveals  that  = t^TT  an<*  hence  (A4-2) 


is  satisfied. 


The  LBLP  is  to  optimally  control 


d\/dT  = -\+u  , \(0)  =0-(-l/2)  = 1/2,  T = t/\i 

K 


with  respect  to 


(4.44) 


h - i J + \>dT 

0 


(4.45) 


The  optimal  control  is 


u (t)  = -k^UT)  = -(V^T)X(t) 


(4.46) 


where  k is  the  positive  definite  solution  to  the  Riccati  equation 


0 - 2k  + k - 1. 


Thus  the  optimally  controlled  LBL  system  is 


(4.47) 


dX./dT  = -*n  ^ 


(4.48) 
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yielding 


\(t)  - X(0)e^*  T,  0 < T < ». 


Similarly,  the  RBLP  is  to  optimally  control 


dp/dJ  = -p+up,  P(0)  = 0-  (-1/4)  = 1/4,  a = (t-l)/M- 


with  respect  to 


1 p 2 2 

jp  ■ a L <P  + V*’ 


The  optimal  control  is 


(4.49) 


(4.50) 


(4.51) 


up  = _kpP<T>  = d+^)P(T) 


(4.52) 


where  kp  is  the  negative  definite  solution  to  the  Riccati  equation  (4.47), 


resulting  in  the  feedback  system 


dp/d a = Jl  p 


such  that 


p(o)  = P (0)e 


, -®  < a < 0 . 


(4.53) 


(4.54) 


Thus  an  0(p.)  approximation  to  the  solution  of  the  full  order 


problem  (4.36)  is 


x(t)  = 1/V2  (t  + 1) 

z(t)  =•  -l/;2(t  + l))+j  e^t/M,+^  ^(t-lO/M- 
p(t)  * Jlj  (t  + 1) 
i(t)  - i/e(t  + i))+i 


u(t)  = -q(t)  . 


(4.55) 
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For  m<  = *1>  the  trajectories  are  shown  by  dashed  lines  in  Figures 
4. 1-4.5.  The  Newton-Raphson  algorithm  in  [37]  is  modified  for  fixed  end- 
point problems  by  using  the  dichotomy  transformation  in  [38]  and  is  used  to 
compute  an  optimal  solution  of  (4.36)  numerically.  Using  (4.55)  as  the 
initial  guess,  the  computation  converges  in  four  iterations  and  the  optimal 
trajectories  are  shown  in  solid  lines  in  Figures  4. 1-4.5.  The  closeness  of 
(4.55)  to  the  optimal  trajectories  are  obvious. 
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4.5  Asymptotic  Expansions 

We  now  proceed  to  obtain  asymptotic  series  expansions  of  x,  z,  p,  q, 
u in  Then  Theorem  4.3.1  follows  from  the  iact  that  (4.28)  consists  of  the 
leading  terms  in  the  expansions. 

Lenina  4.5.1 

Under  Assumptions  (A4. 1)-(A4.3) , the  TPBV  problem  (4.7)  possesses 
a solution  of  the  form 


x(t,p.)  =■  X^t.ix)  + H-m^(r,(J.)  + M-n^(a,p.)  + p.NxN(t,n) 

p(t,n)  = PN(t,p,)  + p,au(T,M.)  + (J.n^(a,M.)  + p-W.ia) 

(4.56) 

z(t,p.)  = ZN(t,p,)  + m^Or.M*)  + n^(cJ,|J.)  + p,NzN(t,p,) 

q(t,u)  - QN(t,^)  + m”(T,^)  + n”(a,M.)  + M-N qN(t,n) 

for  all  N > 0 where 

N ^ i N ^ i 

a “ 2 M-  X.(t,n),  P = E P (t,n) 

l'°  ‘-0  (4.57) 

„ N N 

Z * 2 t*  Z (t,H),  Q = E H Q.  (t.M-) 
i-0  1 i=0 


are  the  outer  expansion, 

N-  i . N 

m.  = Z (T,p,),  k = 1,2,  Z M«  hl  (T,p.),  k = 3,4 

K i=0  K1  K i=0  K1 

(4.58) 

„ N-i  . N 

n,  = Z n,  (CT,p.),  k = 1,2,  il  = Z M-V,  (a  ,p.) , k = 3,4 

K i=Q  K1  K i=0 

are  the  left  and  the  right  boundary  layer  expansions,  respectively,  and 
N N N N 

x , p , z , q are  0(p.)  uniformly  in  the  interval  te  [0,T]  for  p,  sufficiently 
small. 

Proof: 

_N  N N 

Outer  Expansion.  The  outer  expansion  is  obtained  by  substituting  (x  , P , Z , 

N i 

Q ) into  (4.7)  and  equating  the  coefficients  of  like  power  of  p.  , 0 < i < N. 

At  i=0,  (Xq,  Pq,  Z q,  Qq)  is  the  solution  to 

dX0/dt  = a1  + XlZo-  ± S^-  \ SQ0,  XQ(0)  = xo(0),  XQ(T)  -x^O) 

\ (4.59a) 

dP0/dt  = ‘WO’  - Ii'1<iiP0+i2V*  W’0* 


0 - a2+A2ZQ  2 S p0  ‘ 2 S2% 


0 = -V2  - 2V3Zq  - A[Pq  - A^Qq 


(4.59b) 


where  a^  a2>  A^  A^  Bj,  B2>  Sx  = BjR^Bj,  S2  = B^Bg.  S - BjR”1 B^,  V2  and 
are  evaluated  at  Xq,  Pq,  Zq,  Qq  and  pi  = 0.  In  general  for  l<i5N» 

(Xf,  P^,  Zt,  Q^)  is  the  solution  to 


dXi/dt  = 8lx(t)Xi--|  S1(t)Pi  + A1(t)Zi-y  S(t)Qi+Qfli(t) 
dPt/dt  - g2x(t)X1  + g2p(t)Pi  + g2z(t)Zi  + g2q(t)Qi+a2i(t) 


(4.60a) 


t i U 
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0 = g3x(t)xi-J  S,(t)Pi  + A2(t)Zi  -j  S2(t)Q.+Qf3i(t) 

0 = g4x(t)Xi-A[(t)Pi -2V3(t)Z.  -A^(t)Qi  + a4i(t) 

where  the  matrix  coefficients  of  X.,  P , , Z . , Q.  are  evaluated  at 

i i i 

Qq  and  p.  = 0,  and  a^^t),  k«l,2,3,4,  are  known  functions  of  Xr> 
r<i-l.  From  Assumption  (A4.3)  it  follows  that 


)■  (4.60b) 


*2“)  - 2 S2<t> 

-2V3(t)  -A£(t) 


(4.61) 


is  nonsingular.  Hence  Z^,  can  be  solved  uniquely  from  (4.60b)  and 
eliminated  from  the  equations  for  dX^/dt,  dP^/dt.  For  i *0,  it  is  shown  in 
Appendix  C that  the  elimination  of  Zq,  Qq  from  (4.59a)  yields  the  reduced 
TPBV  problem  (4.17)  with  Xq,  Pq  replacing  x,p.  Hence  from  Assumption  (A4.1), 
the  uniqueness  of  solution  guarantees 


(4.62) 


and  Zq,  Qq  are  given  in  (Cl)  of  Appendix  C. 

It  then  follows  immediately  that  for  l<i<N,  the  elimination  of 
Z^,  from  (4.60a)  yields 


dXt/dt  = C1(t)Xi-C2(t)Pi  + orli(t) 
dPt/dt  = -C3(t)Xi-C[(t)Pi  + a2i(t) 


(4.63) 


where  C^,C2>C3  are  given  in  (4.18).  The  boundary  conditions  of  (4.63)  are 
X^(0)  =*  a^  and  X^(T)  =b^  where  a1-,  b^  will  be  specified  later.  Since  C3  is 
positive  semidefinite  and  R is  positive  definite,  the  solution  K^(t)  to 

K =*  -KC1  - C|K  + kc2k  - c3 


(4.64) 
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with  end  condition 


K(T)  = TT. 


(4.65) 


is  positive  definite  in  t e [0,T)  for  any  tt^  positive  semidefinite,  and  the 


solution  Kn(c)  t0  (4.64)  with  end  condition 

K(0)  = tt2 

is  negative  definite  in  t e (0,T]  for  any  negative  semidefinite  [38]. 
Introducing  the  dichotomy  transformation  [38] 

X.  = y . + w . , P.  = Ky.+Kw. 
i i l p^i  ni 

and  substituting  into  (4.63),  we  obtain  the  equations  for  y^  w^  as 

dy./dt  = (C1-C2Kp)yi  + ayi 
dWi/dt  = (C1-C2Kn)w.+aw. 


(4.66) 


(4.67) 


(4.68a) 

(4.68b) 


where 


“ 

* 

0t  . 

I 

I 

yi 

n 

n 

a . 

K 

K 

wi 

P 

n 

_ _ 

— 

_ 

-1 


a 


li 


a2i 


(4.69) 


Let  be  the  state  transition  matrices  of  (4.68a),  (4.68b),  respectively. 

Then  the  solution  to  (4.68)  is 

t 

yt(t)  = 4>1(t,0)yi(0)  + J $1(t,s)0(yi(s)ds 


(4.70) 


wt(t)  = 4>2(t,T)wi(T)  + J $2(t,s)0fwi(s)ds  . 


To  determine  y^O),  w^(T),  we  evaluate  (4.70)  at  t = 0 and  t=T  and  substitute 
into  (4.67)  to  obtain  the  relationship 


U 


yt(0) 


Wi(T)  J L $1(T>0)  Xn  J Lbi-  I $1(T,s)ayi(s)ds 


In  ^ (0,T)  _1  a1  - J $2(0,s)awi(s)ds 

T 


(4.71) 


Thus  given  a*',  b^,  the  unique  solutions y^,  w^  to  (4.68)  and  hence  those  of 
X1#  P^  to  (4.63)  can  be  computed. 

Boundary  Layer  Expansions.  Since  Z(0,p.)  does  not  in  general  satisfy  the 

initial  condition  z (p.),it  is  necessary  to  account  for  this  boundary  layer 
N 

by  mj^TjM-),  k=l,2,3,4,  which  satisfy  at  t = 0 the  equations 


2 = dx.d/  ^2  = d£_d^ 

dT  dt  dt  * dT  dt  dt 

-J  L Jt^J-T  I-  J L Jt=vT* 


, n -i  r rj  si 

dm,  , ,_N  dm. 

3 _ dz_  dZ  4 

dT  dt  ~ dT  ’ dT 

J L J t =Ut  L 


d£  do " 

dt  “ dt 


(4.72) 


to  0 (P<  ) . Hence  we  have 


, N.,  - . N N N N , . 

dra^/dT  = gk(m1,m2Jm3,m4,M.,T) 


= gk(XN(^T)+^(T),pN(UT)  +M.m2(T),ZN0iT)+m^(T), 
QN(HT)+mJJ(T)>M,,M,T)  -gk(XNOiT),PN(^T),ZNCiT), 


, k = 1,2, 3, 4 . 


(4.73) 


Substituting  (4.72)  into  (4.73)  and  equating  the  coefficients  of  like  power 

of  p.*-,  0<i<N,  we  obtain  a system  of  equations  for  the  left  boundary  layer. 

N 

At  i = 0,  the  zeroth  order  terms  of  m^  satisfy 


ti  u 
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Li 


1 7T  / 


dm10/dT  * Al(0)m30  ' 2 S(0)m40 


dm2Q/dr  = g2(X0(0),P0(0),Z0(0)+m30(T),Q0(0)+m40(T),0,0) 


- g2(X0(0),P0(0),Z0(0),Q0(0),0,0) 


(4.74) 


1 - 


dm30/dT  - A2(°)m30'2  S2(0)m40 


dm40/dT  = "2V3 (0)m3Q  " A2 (0)m40 


where  the  initial  condition  of  is  = 2o(0)-Zq(0) , 


Furthermore 


m^Or)  tends  to  zero  as  T tends  to  infinity.  Letting 


"40<T>  ’ 2\(°So<T> 


(4.75) 


where  K^(0)  is  the  positive  definite  solution  of  (4.27)  at  t=0,  we  obtain 

dm30/dT  = ‘VWt-0  m30’  m30(0)  = zo(0)‘Z0(0)  • (4'76) 


Thus  A2"S2K^  is  stable  and  and  hence  m^Q (T ) > decay  exponentially  to 

zero.  Now  comparing  (4.76)  to  (4.20)  controlled  by  (4.25)  we  obtain 


m30(T)  “ • 


(4.77) 


Furthermore,  m^Or),  m20(T)  are  8iven  bY 


-1 


"10<T>  ■ l<ArSV<A2'S2y  't-o 


1 «-™r\  m3o ) 


T dm2Q(s) 

m (T)  = J — ds 


(4.78) 


dT 


Then  the  initial  condition  a of  X^  in  (4.63)  is  given  by 


A 


- b V^^.o-i<VsV(VW'\-o(V0>-zo(0»- 


In  general  m^(T)  satisfies  the  equations 
dmu/dT  = A1(0)m3i  - | S(0)m4.+Mu(T) 

dm2i/dT  = g2z(X0(0),P0(0),Z0(0)+m30(T),Q0(0)+m40(T),0,0)m3. 

+ g2q (XQ (0) , PQ (0) , ZQ (0) + m3Q (T ) , Qq (0) + m4Q (T ) , 0 , 0)m4i 

+M2.(t)  (4.80) 

d^i./ dr  *“  A2(0)m3i  - j S2  (0)m4i  (t) 

dm4i/dT  = -2V3(0)m3i-  A^(0)m4i + M4i<T) 

where  the  exponentially  decaying  terms  M^Or),  k=l,2,3,4,  are  known 
successively.  We  solve  for  the  last  two  equations  of  (4.80)  by  letting 

m4.(T)  = 2Kx(0)m3.(T)  + 0.(T)  (4.81) 

where  satisfies  the  linear  vector  equation 

dP./dT  = -[A2-S2Vt=0  -2Kx(0)M3.(t)+M4.(t)  . (4.82) 

In  [15],  it  is  shown  that  there  exists  a unique  exponentially  decaying 
solution  0^  to  (4.82).  Then  m3i(r)  is  given  by 

dm3t/dT  = [A2-S2K  ] t=0m3i-  J S2(O)0.(T)+M3i(T)  (4.83) 

.<  th  initial  condition  m3i(0)  = [Sizo (M-)/dM<^]^_Q  - Z^(0).  Hence  the  solutions 
*.  * . » • l, 2, 3, 4, to  (4.80)  are  exponentially  decaying.  The  initial  condition 

•.63)  is  given  by 
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a1  = X.(0)  = [aS^OO/^%.0-  mli (0)  - (4.84) 

In  a similar  manner,  the  right  boundary  layer  correction  terms 
N 

n^Ccr.M-)  satisfy  the  equations 

dn^/do  = gk(n1,n2>n3,n4,p,,a) 

= gk(X0ia)  +M-n1(a),P(p0)  +^n2(a),Z(M.a)  + n3(a)  ,Q(M<r)  +n4(a),M.,M-a) 

- gk(X(^a),P(tiCT),Z(p,a),Q(M'a),|J1,tJ.a)  , k=l,2,3,4.  (4.85) 


1 


n 
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The  end  conditions  for  n^^(T),  X^(T)  are 

»3i(I)  ■ 

N N 

It  remains  to  be  shown  that  x , p , 
this  asymptotic  property  has  been  shown  in  detail  in  [14]  for  free  endpoint 
problem  which  can  be  translated  for  fixed  endpoint  problem  without  major 
changes.  Thus  we  shall  omit  this  part  of  the  proof. 

From  Lenina  4.5.1,  we  obtain  the  approximation  (4.28)  of  Theorem  4.3.1 
by  observing  that  (4.28a)  and  (4.28c)  follow  from  (4.62),  (4.28b)  follows 
from  (C2) , (4.77)  and  (4.89),  (4.28d)  follows  from  (C2),  (4.75)  and  (4.87), 
and  finally  (4.28e)  follows  from  (Cl)  and  (4.6). 

4.6  Discussion 

A singularly  perturbed  nonlinear  fixed  endpoint  problem  is  decomposed 
into  three  lower  order  problems,  namely,  the  reduced  problem  and  the  left 
and  the  right  boundary  layer  problems.  Two  special  features  are  that  the 
reduced  problem  does  not  involve  the  singular  perturbation  parameter  and 
the  boundary  layer  problems  are  linear  quadratic.  Combining  the  solutions 
to  these  lower  order  problems  we  obtain  an  0(p.)  approximation  (4.28)  of  a 
solution  to  the  full  TPBV  problem  corresponding  to  (4.1),  (4.2).  Based  on 
the  properties  of  the  lower  order  problems,  we  obtain  an  asymptotic  expansion 
for  this  solution  of  the  full  TPBV  problem.  An  example  illustrates  the  design 
procedure  and  the  computation  of  a locally  optimal  solution  using  a Newton- 
Raphson  algorithm  and  the  0(\i)  approximate  solution  as  the  initial  guess. 
Finally,  it  is  emphasized  that  if  the  fast  variable  z in  (4.2)  is  unstable, 
the  partially  closed-loop  control  (4.29)  which  stabilizes  the  fast  variable 
should  be  applied  to  (4.2). 


- Z.(T) 


- nu(T)  = b1  . 


(4.90) 


N N 

z , q are  0(M>).  However, 
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5.  SYSTEMS  WITH  HIGH  FREQUENCY  OSCILLATORY  MODES 
5.1  Introduction 

Mechanical  and  electromechanical  systems  often  have  slightly  damped 
modes  oscillating  at  frequencies  much  higher  than  the  rest  of  the  system. 

Well  known  examples  are  spring-mass  suspension  systems  and  multi-machine 
power  systems.  In  linearized  models  of  such  systems  some  eigenvalues  have 
small  real  parts  and  large  imaginary  parts.  Typically  they  are  due  to  either 
strong  coupling,  or  small  masses  and  inertias,  or  both.  Synchronous  machines 
connected  through  a low  impedance  can  serve  as  an  illustration. 

In  properly  designed  systems  the  amplitudes  of  high  frequency 
oscillations  are  small  and  their  effect  negligible.  However,  the  analysis 
and  design  methods  must  take  these  potentially  troublesome  modes  into 
account.  This  leads  to  numerically  stiff  problems  requiring  expensive 
integration  routines.  A way  out  of  this  difficulty  is  to  treat  systems  with 
oscillatory  modes  as  singularly  perturbed  systems  and  analyze  their  slow  and 
fast  parts  in  different  time  scales.  Presently  available  singular  perturbation 
methods  assume  that  the  fast  modes  decay  in  the  fast  time  scale  during  a 
boundary  layer  interval.  Thus  they  do  not  incorporate  the  case  of  slightly 
damped  or  purely  oscillatory  modes.  This  chapter  extends  the  singular 
perturbation  approach  to  systems  with  fast  oscillatory  modes. 

Our  approach  is  to  decompose  a system  with  high  frequency  oscil- 
lations into  two  separate  subsystems,  one  containing  the  slowly  varying 
dynamics  and  the  other  containing  the  oscillatory  modes.  We  show  that  the 
decomposition  in  [21,22]  is  also  applicable  to  systems  whose  slightly  damped 
large  eigenvalues  result  in  sustained  high  frequency  oscillations.  The 
slowly  varying  dynamics  can  be  approximately  analyzed  by  averaging  methods 
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[19,20].  However  for  the  linear  time -invariant  case  our  algebraic  decom- 


position is  more  direct  and  yields  estimates  of  the  eigenvalues  and  states 
of  the  original  high  frequency  oscillatory  system.  This  procedure  requires 
only  the  verification  of  an  assumption  given  in  the  next  section  and  the 
computation  of  a matrix  inverse.  Furthermore  our  decomposition  retains  the 
meaning  of  the  physical  variables.  Nonlinear  systems  with  high  frequency 
oscillations  are  also  analyzed  in  a similar  manner.  An  interconnected  power 
system  illustrates  the  decomposition  procedure  and  the  concept  of  coherency 
[39,40]. 


5.2  Mode line 


Systems  governed  by  physical  laws  such  as  Newton's  law  and  Kirch- 
hoff's  law  can  be  modeled  as  second  order  matrix  differential  equations 


s + Ps  + Qs  = 0,  s(t  ) = s , s(t  ) = sf 


(5.1) 


where  seR  and  P,  Q are  rxr  matrices.  We  assume  that  system  (5.1)  is  in  the 


s = , P 


P P 
1 2 


P P 
3 r4 


, Q = 


Qx  Q2/h 


q3  q4V 


(5.2) 


where  n is  a small  positive  parameter  which  arises  due  to  the  presence  of 
stiff  springs  or  small  masses  and  is  responsible  for  the  high  frequency 
oscillations  in  (5. !),.  Then  (5.1),  (5.2)  can  be  rewritten  as  a singularly 
perturbed  system  of  first  order  differential  equations 


x * Ax  + Bz,  x(0)  = x 


M.z  = Cx  + Dz,  z(0)  = z 


(5.3a) 


(5.3b) 


t Hi  Li 
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where 


rH 

CO 

h-* 

» * 

Z1 

s2/p. 

f 

CM 

X = 

a 

, 2 = 

= 

-X2- 

- *1. 

-Z2- 

_ s2/|i 

- 

0 

I ' 

* 0 

0 

A = 

, B = 

.“<*1 

-Pl. 

.-q2 

-^2- 

0 

ol 

0 

I 1 

C = 

D = 

• 

.-<3 

-P3. 

,-Q4 

j 

(5.4)1 


Our  analysis  of  (5.3)  does  not  require  the  matrices  A,  B,  C,  D 
to  be  in  the  special  form  (5.4).  The  only  assumptions  that  system  (5.3) 
has  to  satisfy  are  the  following: 

(A5.1)  The  norms  of  A,  B,  C,  D are  bounded  about  p,  = 0 and  the  state  z is 
of  even  dimension,  that  is,  z e R^. 

(A5.2)  The  matrix  D is  in  the  form 


D 


(5.5) 


where  are  mXm  nonsingular  matrices  and  the  matrix  D2D2 

2 

has  simple  and  negative  eigenvalues  -uh,  i=l,2,...,m. 

There  is  no  restriction  on  the  dimension  n of  the  state  xeRn.  Assumption 
(A5.2)  guarantees  that  high  frequency  oscillations  will  occur  in  (5.3). 

As  an  example  of  a system  in  the  form  of  (5.3),  we  consider  a mass- 
spring-damper system  (Figure  5.1)  where  the  spring  k2  is  stiff.  A set  of 


1 


The  matrix  I denotes  an  identity  matrix  of  an  appropriate  dimension. 
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convenient  state  variables  for  this  system  is  the  position  of  the  center  of 
mass 


sc  = (M1s1+M2s2)/M,  M = M1+M2 
and  the  relative  displacement  between  the  masses 


(5.6) 


Sd  = S1  " S2 


(5.7) 


where  s^,  s^  are  the  positions  of  the  masses  M^,  The  equation  of  motion 

for  this  system  is 


fl  . flM2  . kl  flM2 

+ T7 ' S + — S , + — S + — S , = 0 


c Me 


d M c 


'1  . 


s (0)  = s , s (0)  = v (0)  = v 
c co  c c co 


f 1M2  f2M 


k2M 


■a  + zr  K + + ttzt)  h + + zhr  d + -*-?>  s . = o 


d M:  c M^M 


M1M2/  °d  1 c ' M1^ 


k2M2; 


sa(°>  = Sdo’  ®d(0)  = V^(0)  = * 


do 


(5.8) 


Since  the  spring  k2  is  stiff,  we  define 

i_  VL. 

= *1*2 


(5.9) 


such  that  p.  is  small.  In  the  state  variables 


X1  = V x2  = Sc  = V Z1  = sd /v>  ’ z2  = V**  = vd/tA 


(5.8)  becomes 


X1  = X2 

^1  £l  2 klM2  £1M2 

X2  ' M X1  - M X2  • m2  Z1  “ “ n2  Z2 


(5.10) 


Before  analyzing  (5.3),  we  investigate  the  behavior  of  the  system 

|J.w  = Dw  + u,  w(0)  =wq  (5.: 

where  D satisfies  Assumption  (A5.2).  The  characteristic  polynomial  of  D/u 
is 


\i  - d3 

-D2/P« 

900  = det 

-d3/h 

- d4  _ 

— » 

0 

-d2/m-+h(xi-d4)d31(\i-d1) 

= det 

L 3 

\!-d4  J 

=*  -(-l)mdet[\2I  -X(D4  + D31D1D3)  - (D2D3  -M.2D4d‘1D1D3)/^2]. 


(5. 


Let  T diagonalize  D2D3  such  that 
TD2D3T_1  = A 

2 2 2 

= diag  (-u)1 , -u>2 , . • • , -<i)m)  (5. 

and  rewrite  the  characteristic  polynomial  as 

« 2 2 
cp(\)  = -(-l)mdet[\ZI  - R1\-(A+p.  R2)/m.  ] 


(5. 
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where  = T (D^  + D^^D^D^T  * and  = TD^D^^D^D^T  Neglecting  p,2R2  and 
the  off-diagonal  elements  of  R^,  (5.15)  is  approximated  by 

?CO  - -(-I)”  tt  (\2-2a.X  + u)^/P‘2)  (5.16) 

i=l  1 1 

where  2a ^ is  the  ith  diagonal  element  of  R^.  Instead  of  (5.13),  cp(x ) can 
be  expressed  as 

cp(X)  = -(-l)mdet[\2I-X(D1  + D21D4D2)  - (D^  - P^DjD^D^^/p.2] . (5.17) 

-1 

Letting  S = FTD^  where  T is  any  nonsingular  diagonal  matrix,  we  obtain 
SD^D2S  ^ = A.  Then  the  diagonal  elements  of  S (D^  + ^ are  identical 

to  those  of  R^  and  (5.17)  can  also  be  approximated  by  (5.16).  To  analyze  the 
roots  of  cp(A.)  we  use  the  following  lemma. 

Lemma  5.3.1:  If  D satisfies  Assumption  (A5.2),  then,  as  M 0+,  the  eigenvalues 
of  D/p.  approach  infinity  as 


a±  ± ju^/p.,  i = 1,2, .. . ,m.  (5.18) 

By  Lemma  5.3.1,  as  p.  -»  0+,  the  eigenvalues  of  (5.12)  approach 
infinity  along  asymptotes  parallel  to  the  imaginary  axis.  Note  that  the  large 
imaginary  parts  of  (5.18)  are  the  consequence  of  solving  for  X of  the  quadratic 
equations  in  (5.16).  If  some  of  the  eigenvalues  of  D2D^  are  either  positive 
or  not  simple,  then  in  general  some  of  the  eigenvalues  of  D/P-  may  be  positive 
and  0(1/^).  This  case  of  fast  instability  is  less  realistic  and  will  not  be 
considered  here. 

Due  to  the  eigenvalues  with  large  imaginary  parts,  the  response 
w(t)  of  (5.12)  contains  high  frequency  oscillations.  However,  w(t)  also 
contains  a slowly  varying  part  because  of  the  input  u(t). 


! 
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Leima  5.3.2:  If  D satisfies  Assumption  (A5.2)  and  if  u(t)  = u(t) +u(t)  is 
an  input  where  u(t)  is  a slowly  varying  part  with  Ju|  <c^  and  |u|  <_  c ^ for 
some  fixed  ^ and  c 2>  then  there  exists  a finite  T(M-)  such  that  the  slowly 
varying  part  w(t)  of  w(t)  of  (5.12)  for  0 <t<T  is 

u(t)  + 0(n)  . (5.19) 

Proof:  Integrating  the  variations  of  constants  formula 

1 

w(t)  = *(t,0)wo  + ~ J *(t,r)u(T)dT  (5.20) 

0 

where  $(t,r)  = exp[D(t-T)/p<}  ,by  parts,  we  obtain 

w(t)  = -D_Lu(t) +$(t,0)wo  + D-1$(t,0)u(0) 

, t . . t 

+ D"1  J *(t,T)u(T)dT  + J J *(t,T)u(T)dT  . (5.21) 

0 0 

But  the  first  integral  term  in  (5.21)  is  0(M-)  since  a further  integration  by 
parts  reveals  that 

t . , t 

| J $(t,T)u(T)dT|  <M-|d  |{c  (1+ |$(t,0)|)+c2  J |*(t,T)|dT}  . (5.22) 

0 0 

We  also  note  that  u(T)  generates  high  frequency  terms  and  the  terms  contri- 
buted by  $(t,0)  are  approximately  of  the  type  exp(c^  t)sin(u)^  t /l-** ) and 
exp(CT^  t)cos(u)^  t/p.),  i=l,2,...,m.  Since 


Xj  - -(D3  -n2D4Dj1Dl)'1D4D‘1 
*2  " 

X3  - -D-lDlXl 

X4  - -(D2 -H2D1d‘1D4)"1D1D31  , 

the  only  significant  slowly  varying  part  -D  *u(t)  of  w(t)  in  (5.12)  is 
approximated  to  O(p-)  by  -D  *"u(t),  where 
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(5.23) 


(5.24) 


D = 


°3  ° 


(5.25) 


implying  (5.19). 


This  analysis  justifies  a simple  formal  method  to  obtain  w(t),  that 
is,  let  M- * 0 in  (5.12),  as  is  usually  done  in  singular  perturbations. 

However,  the  meaning  of  letting  p.  = 0 here  is  different.  Considering  u = u as 
the  input  and  w as  the  output,  the  input-output  behavior  of  system  (5.12)  is 
that  of  a lowpass  wideband  filter.  Then  w(t)  is  the  dominant  part  of  the 
filter  output  which  shows  the  relationship  with  the  usual  assumption  in  the 
technique  of  averaging  [20].  Thus  w(t)  approximates  w(t)  closely  if  the  high 
frequency  component  of  w is  negligible  or  if  w(t)  is  used  as  an  input  to  a 


slow  filter. 


5.4  Eigenvalue  and  State  Approximations 

Letting  x be  the  slowly  varying  part  of  x and  either  applying 
Lemma  5.3.2  to  (5.3b)  or  setting  |i=0,  we  obtain  the  slowly  varying  part 


z of  z as 


z = -D  ^Cx  + 0(h) 

= -D_1Cx  + 0(H)  . 


(5.26) 


To  completely  separate  the  slowly  varying  part  z from  z,  we  introduce  the 
change  of  variables 


H = z + D Cx  + HGx  s z + Lx 


(5-27) 


and  determine  G such  that  (5.3)  is  transformed  into 


x = (AQ  - HBG)x  + Bn 


(5.28a) 


H‘l  = (D  + HLB)Tl 


(5.28b) 


where 


AQ  = A - BD_1C. 


(5.29) 


Thus  G is  required  to  satisfy 


-DG  + (D  C + HG)(Aq-HBG)  = 0. 


(5.30) 


By  the  implicit  function  theorem,  the  solution  of  (5.30)  is 


where 


G = D CAq  + O^) 

= d'2ca0  + 0(h) 


Aq  = A - BD-1C 


(5.31) 


(5.32) 


D+HLB 


°3  ^4 


'2  ™1 
+ p. 


CB  + OP  ) 


°3  ^°4 


I 
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M'(D1  + D31C2B1)  D2+^d"1C2B2 


°3  +|iD2lciB2 


^(d4  + d21c1b2) 


+ Ofti  ) 


where 


\ ■»* 


[B1  B2J  • 


+ 0(|i2)  S D + 0(M.2) 


C = 


(5.33) 

(5.34) 


Then  the  upper  block  triangular  form  (5.28)  exhibits  the  eigenvalues  of  (5.3). 
Lemma  5.4.1:  If  Assumptions  (A5.1)  and  (A5.2)  are  satisfied,  then  the  eigen- 
values of  the  original  system  (5.3)  are  0(M>)  close  to  the  eigenvalues  of 
Aq  and  T5/M- . Furthermore  as  (i  0+,  the  eigenvalues  of  ’B/p,  approach  infinity 
as 

i = 1,2, ...  ,m  (5.35) 

fw  -1 

where  2p^  is  the  ith  diagonal  element  of  the  matrix  1(5^  + D^D^)T 

The  second  statement  of  Lemma  5.4.1  follows  from  Lemma  5.3.1. 

The  meaning  of  Lemma  5.4.1  is  that  n eigenvalues  of  system  (5.3)  are  small. 
They  are  responsible  for  the  slowly  varying  dynamics  of  the  system.  The 
other  2m  eigenvalues  have  large  imaginary  parts  and  are  responsible  for  the 
high  frequency  oscillations. 

To  separate  the  slowly  varying  part  in  x,  we  introduce 

§ = x - p.  (CD  1+p,N)Tl  s x - m-HT)  (5.36) 


and  choose  N such  that 


B+p,(AQ  - p,BG)H  - H(D  + p,LB)  = 0 . 


(5.37) 


AO- A 057  644  ILLINOIS  UNIV  AT  URBANA-CHAMPAIGN  DECISION  AND  CONTROL  LAB  F/G  12/1 

SIN6ULAR  PERTURBATION  OF  NONLINEAR  REGULATORS  AND  SYSTEMS  WITH  --ETCCU) 
DEC  77  J H CHOW  DAAB07-72-C-0259 

UNCLASSIFIED  DC-8  NL 


MICROCOPY  RESOLUTION  TEST  CHART 
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By  the  implicit  function  theorem. 


V50'2 

-2  -1 
- BD  CBD 

t oo*) 

- — 2 

— 2 — 1 

+ 0(H) 

AoBD 

- BD  CBD 

(5.38) 


This  completes  the  transformation  (5.27),  (5.36)  which  becomes 


§ 

I -HHL 

-HH 

X 

= 

11 

L 

I 

z 

and  its  inverse  is 


X 

"i 

HH 

"S' 

z 

ss 

-L 

I -HLH 

n 

- 

. 

- 

— 

The  original  system  (5.3)  rewritten  in  the  state  variables 
decomposed  into  the  fast  and  slow  subsystems 


(5.39) 


(5.40) 

§,  T1  is  completely 


5 = (5.41) 

M*T\  = J9  T1  (5.42) 


where  C = Aq  - |*BG,  $ = D + M.LB. 

The  decomposition  (5.39),  (5.40)  is  an  exact  block  diagonal izat ion 
transformation.  Neglecting  the  0(h)  term  in  (5.41),  we  define  the  slowly 
varying  subsystem  of  (5.3)  as 

x = Aqx  , x(0)  = x^  (5.43a) 

~z  - -D~1Cx  . (5.43b) 

The  oscillatory  subsystem 

Hz  - Dz,  5(0)  = zq  + D 1Cxq  (5.44) 

2 

is  obtained  from  (5.42)  by  neglecting  the  0(H  ) terms  in  & . 

The  state  approximations  achieved  by  the  subsystems  (5.43),  (5.44) 


are  stated  as  follows. 


89 

Theorem  5.4.1:  If  the  original  system  (5.3)  satisfies  Assumptions  (A5.1) 
and  (A5.2),then  the  states  of  (5.3)  are  approximated  to  O(M')  by  the  sub- 
systems (5.43),  (5.44)  for  0<t<TOA),  that  is, 

x(t)  = x(t)  + 0 (jJ. ) (5.45a) 

z(t)  = z(t) +z(t) +0(p.)  . (5.45b) 

The  result  of  Theorem  5.4.1  implies  that  if  the  initial  condition 
|z(0)|  is  much  smaller  than  |x(0)|,  then  the  high  frequency  oscillation  can 
be  neglected  and  the  original  system  (5.3)  is  adequately  modeled  by  its  lower 
order  slowly  varying  subsystem  (5.43).  Furthermore  the  subsystems  (5.43), 

(5.44)  can  be  used  to  simulate  approximately  the  actual  response  of  (5.3). 

Due  to  the  presence  of  the  ill-conditioned  (n  + 2m)-th  order  system  (5.3) 
requires  a prohibitively  small  integration  stepsize.  However,  using  the 
lower  order  subsystems,  the  small  integration  stepsize  is  necessary  only 
for  the  2m-th  order  fast  oscillatory  subsystem  (5.44),  while  the  integration 
of  the  slowly  varying  subsystem  (5.43)  can  be  computed  with  a much  larger 
stepsize,  resulting  in  savings  of  computing  time.  In  the  case  when  the  high 
frequency  oscillations  are  negligible,  only  the  integration  of  the  slowly 
varying  subsystem  is  required. 

We  illustrate  the  subsystem  decomposition  procedure  with  the  mass- 
spring-damper system  (5.11).  Neglecting  the  M>  terms,  the  slowly  varying 
subsystem  (5.43)  of  (5.11)  in  the  original  state  variables  is 
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s 

c 


V 

c 


V 

c 


ii-  £1 - 

M 3c  M V 


sc(°) 

vc(0) 


s 

CO 


V 

CO 


3d 


0 


0. 


(5.46) 


Subsystem  (5.46)  represents  the  motion  of  the  center  of  mass  as  if  and 
M2  are  connected  by  a rigid  rod  and  are  moving  together.  Intuitively  this 
is  the  limiting  case  as  M>  0+,  that  is,  as  k-»ao.  The  high  frequency 
oscillation  between  the  masses  is  modeled  by  the  fast  oscillatory  sub- 
system (5.44) 


f 1^2  f2M  - 

'*1  ’P,(M1M  + M1M2)Z2 


Zl(°)=sdo^2 

22(0)=Vdo/M" 


(5.47) 


Subsystem  (5.47)  describes  the  motion  of  the  masses  and  M2  connected  by 
a spring  and  a damper  £,  +f^M^/M^  as  the  equation  for  sd  is 


that  is. 


flM2  f2M  i 1 _ 
Sd  + ( MLM  + M1M2^S  + 2 Sd 


**1^  - fA  jt, 

— 3d  + <f2  + TT>3  d + k25c 

n 


(5.48) 


(5.49) 


Since  the  spring  is  stiff,  the  initial  displacement  is  small  because 

a large  amount  of  energy  would  be  required  to  significantly  change  the  length 

2 

of  the  spring.  Thus  in  systems  with  finite  energy,  z ^ - s^/p.  *-s  not  lar8e 

and  is  actually  properly  scaled.  The  same  property  holds  for  Z2  = v^/M- 
as  js^j  * ^ivjl  due  t0  t^ie  high  frequency  oscillations  in  s^. 
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Thus  concluding  from  Theorem  5.4.1,  if  the  initial  conditions 

s,  and  v,  are  of  0(p.),  we  obtain 
do  do 

sc  * sc  + 0(p.)  , 
sd  = O0J-), 

5.5  Nonlinear  Systems 

We  now  extend  the  analysis  in  Section  5.4  to  nonlinear  systems. 

The  system  of  second  order  differential  equations 

= f1(s1»  s2,  s ^ , s ^ y M>) 

2 2 
= g1(s1,s1,s2/|j,  , s2M)  + ^h1(s1J1,s2/n  , s2/m.,h) 

*2  = f2(V  V #1*  V **> 

5 Gs2/m-2 +g2(s1,s1)  + M'h2(s1,s1,s2/^2,  s2/^.) 

+ M-2h3(s1,s1,s2/p.2,  s2/m-,M-)  (5.51) 

where  the  states  are  s^eRn  and  s2eRm,  is  assumed  to  satisfy  the  following 
assumptions : 

(A5.3)  The  limits 


lim  |h1(a1,a2,a3,Q(4,ti)|  < <* 

(5.52) 

M.-*0+ 

lim  |h3(al,a2,a3,a4,^)|  <« 

(5.53) 

H-*>+ 

exist  for  all  finite  vectors  Q,i»a2,a3,a4* 

(A5.4)  G is  stable  and  its  eigenvalues  -ou2,  i»l,2,...,m,  are  simple 


v = v +0(m,) 
c c 


vd  = OGi)  . 


(5.50) 


and  real 


With  the  change  of  variables 


sl*  X2  " V Z1  = s2^  ’ Z2  " V^ 


(5 


system  (5.51)  becomes 


X1  " X2 


&2  = f^(x2>  x^,  |i  z^,  M>) 


(5 


^Z1  = Z2 


P*z2  = f2(x2’  Uz2*  Xl*  * zl»  ^ 


Formally  letting  H-»0  , system  (5.55)  becomes,  under  Assumption  (A5.3) 


X1  “ X2 


*2  * ?i (*i>  *2*  zi»  z2) 


Y <5 


0 « z„ 


0 - GzL  + g2(xis  x2)  . 


y (5 


From  Assumption  (A5.4),  we  eliminate 

-1 


zi  * “G  82  *2) 


z2  - 0 


(5 


from  (5.56a)  to  obtain  the  nonlinear  reduced  system 


X m X 

XI  2 


-1 


x2  * gl(xl,X2*  " G g2^*i»*2^*  0) 


(5 


a g(x1(x2)  . 


This  system  describes  the  motion  of  the  slow  parts  of  the  states  x and  z 
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To  exhibit  the  fast  oscillatory  behavior,  we  introduce  the  change 
of  variables 


^l  • *1  + G"1g2 (*i»x2) 
\ = Z2  * 


Then  system  (5.55)  becomes 


X1  = X2 


x2  * fl(x2’  ^2’  xl»  ^(Tl1-G-1g2(x1,x2))^) 


(5.59) 


S (5.60a) 


M-tl2  ■ f 2 (x2 * ^2’  xl»  ^(\  " g’A82(xi»x2^»M’) 


^ (5.60b) 


In  (5.60b)  we  approximate  x^tx2  by  xi»^2  an<*  ne8lect  the  higher  order  p.  terms 
to  obtain  the  fast  oscillatory  subsystem  as 

■ J2+llG'1[*2ltl(ifl-i2)S2+82x2(Sl>I2>8l<3ErS2> 
a % ^ 

X1  ” G g2(x1»5t2)»*2^  S z2 +l*k1(z1,z2,t) 


(5.61) 


M-x2  = Gal+M,h2(x1»x2»z1  - G"  g2(x1,x2),z2) 

5 G*i  +^k2  (x1»z2»t) 

where  z^»z2  approximate  T\ ^ , T\2 , respectively,  and  x^»x2  are  expressed  as 
known  functions  of  t.  System  (5.61)  is  poorly  damped  and  high  frequency 
oscillations  are  dominant  in  and  z2>  From  (5.58)  and  (5.61),  it  follows 
that  there  exists  a finite  T(p.)  such  that  for  0<t<T, 


*i(t)  - x£(t)  + 0(H) 


zi (t)  - z£(t)  + zl(t)  + 0<H) 


i - 1,2  . 


(5.62) 


w 


T 


9- 

Higher  order  approximations  of  z±,  i = l,2,  can  be  obtained  by. 

introducing  a change  of  variables  of  the  type  (5.59)  which  is  accurate  to 
k 

0(1*  ),  k>l.  Other  less  rigorous  approaches  such  as  linearizing  the  fast 
variable  1^, in  (5.60b)  and  retaining  in  f^  when  solving  for  z # may  also 
improve  the  approximation.  These  ideas  are  illustrated  with  a power  system 
example. 


5.6  A Power  System  Example 

Consider  the  three  machine  system  in  Figure  5.2.  The  opening  of 
one  transmission  line  from  bus  1 to  bus  2 causes  the  system  to  oscillate. 
The  following  post-disturbance  differential  equations  for  the  machine  rotor 
angles  may  be  written  [24] 


M151  ’ Ptn1-,i2l(llC“9ll  -V;V2?12COsW12  +62-6l)-',iV3rUCOS<ei3  + 83'Sl) 


M2!2-PiB2-Vi2’t22CO9e22-V;V2''l2CO9«12+6rS2)-V2V3Y23COS<023  + S3-62>  <5-63> 


"363  * Pln3-V3%3c°9  833  ‘Wir  <9 13  + 5 I’V  -ViV?23c°9  <923  + W 


The  notation  for  this  and  other  equations  of  this  example  is  given  in 
Appendix  D. 


If  Y23  is  large  compared  to  Y^  and  Y^»  then  machines  2 and  3 
will  be  strongly  coupled.  In  this  case  it  is  convenient  to  rewrite  (5.63) 
in  terms  of  the  variables 


cl  M2+M3  " 8l*  623  " 62-63 


(5.64) 


as  a fourth  order  system 


*1*2*12 


5cl"Fl"  M^2  cos  (^12  ” M 623_6cl)  ■ Cos(Y13+M  623_6cl 


2V2V3 


Y„_cos  0_  cos  6, 


M 23  23  23 


V' V'Y 
*1*2*12 


23  2 


«2 


'12  “cl  ' M “23; 


Wl3 


6-o  - F„ cosO-.-S^,  - — 8,,,)  + — cos (8, ,“6^.,  +—  6 


”3 


13  “cl  1 M “23 


V1  V'Y 
2 3 23 

“■<T23*823> 


where  6^  is  used  as  Che  reference  and 


Pin2+  Pln3-V22Y22c°s622-V32lf33c°ae33 


,.2, 


pini-vi  YU“S9U 


M 


M, 


Pin2'V2  Y22COS022  Pin3"V3  Y33COS033 


“3 


Since  Y^  is  large  compared  to  Y19  and  Y^,  we  define  p,  as 


12  13’ 


V’ V’Y 

1 *2*3*23 


\i2  **23 

With  the  change  of  variables 


X " ficl*  Z = *23^ 


system  (5.65)  becomes 


V' V'Y 
*1*2*12 


x =*  F, ~w~  cos(Y  - t*  — z-x  ) 


1 M 


12 


^ 

12  ^ M, 


V'  V'Y 

*1*3  13  - _ 

ITT2  cos  (Y 13 -g-  z-x)  - 


2 “2  % 2V2V3Y23 


‘13 


M cosG^cosp-  z 


f,  (X,J*  *) 


Li 


2- 

M-  * = F, 


ViV2Y12 

/a  ,2 

*3 

M2 

cos(012  -p. 

M 

ViV3Y13 

2 

1 

Mo 

cos(913  + g 

M 

2 ^23 
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(5.69) 


f2(x,  g.  z,  p.)  . 


Note  that 


1 2 12 
lim  —x  cos  (Y  _ - g z)  =*  11m  -=•  sin  g,  z * z 

g-*0+  g g-K)  g 


(5.70) 


as  ^23  = 90° • Thus  system  (5.65)  satisfies  Assumptions  (A5.3)  and  (A5.4), 
Letting  g-*0+,  the  nonlinear  reduced  system  of  (5.69)  is 


x = f^(x,0) 


(5.71) 


v 1 V’  V V'  V'  Y 

— V1V2I12  — vlv 3*13 

Z=f2-— CO8(012-X)+— COS(013-X)  . 

Equation  (5.71)  describes  the  oscillation  of  the  center  of  inertia  of 
machines  2 and  3 with  respect  to  machine  1.  Since  machines  2 and  3 are 
relatively  weakly  tied  to  machine  1,  this  oscillation  is  of  a relatively 
low  frequency.  The  fast  oscillatory  subsystem  of  (5.69)  is 


2" 

g z = -z 


(5.72) 


which  is  linear.  Equation  (5.72)  describes  the  oscillation  of  machine  3 
with  respect  to  machine  2.  Since  the  connection  between  machines  2 and 
3 is  relatively  strong  (compared  to  their  respective  connections  to  machine 
1),  this  oscillation  is  of  a higher  frequency  than  the  oscillation  of  the 
center  of  inertia  of  machines  2 and  3 with  respect  to  machine  1. 


The  true  states  of  (5.65)  are  then  approximated  by 


6 - x 

cl 


v -2-2* 
623  ~ M-  z + P-  2 • 


(5.73) 


For  the  initial  conditions 


6cl(0)  = 14.11° , 623(0)  = -1.86* 


(5.74) 


6ci,  8^,  ^23  anc*  ®23  are  P*-otte<*  *-n  Figures  5.3  and  5.5  and  p z is 


plotted  in  Figure  5.4.  The  agreement  between  6^  and  6^  is  excellent. 


However,  there  are  amplitude  and  frequency  discrepancies  between  &23  an<*  623* 


To  correct  for  the  amplitude  discrepancy,  we  retain  the  p terms 


in  f2(x,  p z)  and  solve  for  the  slow  part  of  z from 


0 = f2(x,  p,2z). 


(5.75) 


2=  7 

The  value  of  p z is  plotted  against  p z in  Figure  5.4  whose  shows  that 


including  p.  produces  roughly  a 20%  shift  in  z.  Figure  5.6  shows  that 


m 2=  2- 
623  = **  Z + **  Z 


(5.76), 


approximates  623  better  than  623  in  amplitude. 


To  compensate  for  the  frequency  discrepancy,  we  linearize  f 2 


about  2*0  to  obtain 


p z = (-1  - p 


2 WlA 


s in  (6 12  - x) 


(5.77) 


2 


sin(013  - x))z 


Figure  5.7  shows  that 


« 2“  2» 

J23=m+Pz 


(5.78) 


approximates  623  very  closely,  both  in  frequency  and  amplitude. 


In  conclusion,  the  decomposition  procedure  applied  to  the  power 
system  (5.65)  exhibits  the  coherent  angular  displacements  of  machines  2 
and  3.  In  addition,  the  oscillations  between  machines  2 and  3 can  be 
recovered  from  the  fast  oscillatory  subsystem. 

5.7  Discussion 

It  has  been  shown  that  singular  perturbation  techniques  are 
applicable  to  systems  which  possess  slightly  damped  modes  oscillating  at 
high  frequencies.  Our  analysis  procedures  consist  of  first  identifying 
the  small  parameter  (A  and  expressing  the  system  in  the  form  (5.3).  Then 
the  original  system  is  decomposed  into  a slowly  varying  subsystem  and  a 
fast  oscillatory  subsystem.  Using  these  subsystems,  we  obtain  0(n) 
approximations  of  both  the  eigenvalues  and  the  states  of  the  original 
system  (5.3).  Beside  the  computational  advantages  of  dealing  with  the 
lower  order  subsystems,  the  concept  of  subsystems  contributes  to  the 
understanding  of  structural  properties  of  physical  systems.  A mass-spring- 
damper  example  shows  that  a stiff  spring  can  be  regarded  as  a perturbation 
of  a rigid  rod,  the  imperfection  resulting  in  high  frequency  oscillations 
between  the  masses.  In  an  interconnected  power  system,  neglecting  the  inter 
machine  oscillations,  the  power  angles  of  the  tighly  connected  machines 
are  shown  to  be  coherent. 
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6.  CONCLUSIONS 

This  thesis  applies  the  techniques  of  singular  perturbation  to 
the  studies  of  nonlinear  optimal  control  problems  and  systems  with  high 
frequency  oscillatory  behavior. 

The  stability  properties  of  a class  of  singularly  perturbed  non- 
linear systems  are  investigated  through  the  construction  of  a composite 
Lyapunov  function  based  on  the  stability  properties  of  the  reduced  system 
and  the  boundary  layer  system.  Beside  relaxing  the  condition  that  the 
linearized  reduced  system  be  asymptotically  stable,  the  introduction  of 
a small  parameter  into  the  composite  Lyapunov  function  enables  us  to 
obtain  a predicted  domain  of  stability  which  is  substantially  larger  than 
those  obtained  in  previous  works. 

In  contrast  to  the  open-loop  solution  obtained  for  finite  time 
optimization  problems,  we  propose  a series  expansion  solution  to  the 
Hamilton- Jacobi  equation  for  nonlinear  regulator  problems.  As  a result, 
near-optimal  feedback  controls  are  obtained  which  readily  incorporates 
stability  requirements. 

For  fixed  endpoint  nonlinear  optimal  control  problems,  we 
decompose  the  full  order  problem  into  three  separate  lower  order  optimal 
control  problems.  The  advantages  of  this  approach  are  that  although  the 
reduced  problem  is  nonlinear,  it  is  of  lower  order  and  that  the  boundary 
layer  problems  are  linear  quadratic.  Hence  the  lower  order  problems 
are  much  easier  to  solve  than  the  full  problem. 

For  systems  with  high  frequency  oscillatory  behavior,  we  propose 
a novel  approach  of  applying  singular  perturbations  to  decompose  the 
original  system  into  a slowly  varying  subsystem  and  a fast  oscillatory 
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subsystem.  A mass-spring-damper  system  and  an  interconnected  power  system 
illustrate  that  the  decomposition  schene  is  consistent  with  physical 
interpretat ion . 


APPENDIX  A.  DC  MOTOR  PARAMETERS 


Specifications  of  a DC  motor  used  in  [30]. 
200  rpm 

.00885  n 

.00015  H 

2850  A 

700  V 

.951  n 

2.58  H 

128.5  A 

122.2  V 

2480  lb-ft-sec 
.0529  lb- ft /A2 . 
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APPENDIX  B.  EQUIVALENCE  OF  VQ  AND  L 


Substituting  (3.26)  into  (3.23)  and  rearranging  yields 


°-Xl+  VoA  "4  V0xX3V0* 


where 


Xx  - p - (s'  +2a£V2)A2'la2  - (js*  +a^V2)A2_1B2R"1B^‘1(j  s +V2a2) 

h - b„r1b; 

s * *i  - <v  *iR' S 

<V 

*2  - *2  - B2r1b272  • 

Let  H - Ir+R"1B^V2A21B2.  Then  H_1  » Ir- R^B^VjA"^  and  H'  ™1RH~1 
= R + BlAl " 1QAr1B0  - R • Thus  B - B.H-A.A^B-  = B H.  Hence  X-  - B R '1B'  . 

i.  L L L O O I 1 L L O J OOO 


Also, 


*2  ' VBoRoll<R'W2A2"1<!R2lB2>R'lB2V2'1+B2A2’l72la2+lBoRolB2A2'ls 

' *0  +BoR«1b2A2'1(A2'?2  +0*2  V'1^  +R2A2-  W'^VV' 

+2  v;Vw1b 

- a -B  R_1s  . 

O OOO 


Furthermore,  A2  1 BjR  *8^  1 » A2^B2HR  Sl'B^A^  1 * A21b2Rq1b2A2  1 and 


T 
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— -i  _1  -1 “1 

A2  * A2  +A2  B2R  B2V2A2 

- A2l  +4!'1  B2EolB2<;r2  +Af  Wv’Vz^'1 

* *2‘l  - *2  SC'^'V 

Thus  Xj  becomes 

XL  » p -s'A^+s'  Aj^R"1^"1^1  -|s'A21B2R^1B^_1s 
+ a2^2A2  1b2Ro  1b2A2 " ^2a2  * a2  ^2^2^  +A2~^  ^2>a2  ‘ 

But 

'A'1  +A5'1  ?2  ■ -V2’1  ■Ai'\  +V2A21»2IC1b2A2'W  +Af 

+ 2V,A"  1b,r"  1bia;  ‘ 1 v_ 

l L 2 O l i 2 

- •«;'1y!«'1ljV2i2'lt(fj  +A^‘1Q)A2lB2R^lBJAj'1(V2+C!A21) 

+ viV;1^'1  vm'1^  V;Vf 

and 

SV^V;1  * t “ (V 2 +A2 " S )A2 1 + A2 _1^2B2R"1b2 V2 1] B2R"1b2 V2 1 ’ 

that  is, 

^W’ViVi1  " "(V2 +A^‘1Q2)A21B2r'1B^V2A2"1 

* (^2  + A^'1Q)A21B2R"1B^“1(QA21+V2), 

implying  Xj  * Pq  - s^Ro*so.  Hence  elimination  of  from  (3.23)  yields  the 
Hamilton- Jacobi  equation  (3.14)  of  the  reduced  problem. 


Li 
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APPENDIX  C:  EQUIVALENCE  OF  x,p  AND  Xq.Pq 


30  - -IR'l«ir0+82V' 


From  (4.59b) 


Z0  ■ -A2'1(*2+B2U0) 

- -(A2  +S2A’-1V3)"1(a2  +J  S2Xf%  - J i2R  _1  B'Pq) 
Q0  - -^'1(V2+2V3Z0+A;p0) 

» - (T  +R  A*_1u  \'-1|-aF  -2V  A_1n  'l  + CA ' +VA-"lS' ' 


(A2+S2A^  lV3)'  "[0^2-27^2^) +(A^+V3A2  "S' )P0]. 


Therefore 


UQ  - - J R'1  [I-B*  (A2  + S 2A ^ ' 1V 3 ) ' ‘ 1 (A [ + _1S')]P0 

" 2 R ” 1 B2 (A2+?2A*_1  V3) ' "1(V2-2V3A2“1 12) 

- - \ -^■1(A^+V3A2'1S2)(A2+S2A^’1V3),_1 

• (k[  + V^’ 1S) ] PQ  - JL3 'I’A'  ' 1 (A^  +V^2  1 S2 ) (C3 

• (a2+s2a^'1  v3)  • *1(v2-2v3a21I2) 

- - \ L3l[i'1+B2A^‘1V3A21S-I^-1(A^+V3A2“1S)]P0 

- 2 L3 Li^‘1(i?2-2V21*2) 

* • L31<L2+f8'P0>- 

Substituting  (C3)  into  (4.59a)  yields 

dXQ/dt  - (a  1-A XA " Xa2 ) + (B^”A jA~  1B2 )Uq 
s a + BUn 


J 


dP0Mt  - -IVljl+*JV2x+V3l*0+nS,*o0+?0(*l*+AUz0+,ta,'0) 

+ «0<I2,+Wo+52xV]' 

* “CPlx"a2A2  ^2x+82*2  ^3xA2  a2"^2~2a2A2  ^2  *a2-A2xA2  a2* 

+ P0<alx  + Alx¥<-VW  +52D0 

+i2xV»+’,0<-*&l72x+  2 P2A2  " 1 73xA2  'a2 

+ 2^*2  " 1 ¥2 ' 1 (*2  x + *2  x"2  > 1 (72  -2  V2  ’ 1 *2  > 

-¥T^ +0J«x 
+ 25’A'-1V3A''1(-A2]tA2'1i2  +B2jc))D01  ' 

' -tllx+2OiL2,+UiL3x’I0  + Pi'ax+ix’,0»' 

- ”7xH(X0,P0,U0,t).  (C5) 

In  (C5),  the  partial  derivative  of  an  n^Xn^  matrix  G with  respect  to  x results 
in  an  nn  Xn  Xn  matrix  G and  its  pre-  and  post -multiplication  by  an  n -vector 
h^  and  an  n^ -vector  h2  is  defined  as 

nl  n2 

h!G  h,  * ^ 2 h.  h,,G..  (C6) 

1x2  i«i  j=i  11  2i  iJx 

where  h^  is  the  ith  component  of  h^  h^  is  the  jth  component  of  h2  and  G<j 
is  the  (i,j)-th  element  of  G.  Thus  the  equations  for  Xq.Pq.Uq  are  identical 
to  the  equations  for  x,p,u.  Hence  from  the  uniqueness  Assumption  (A4.1) 


x0  ■ x > P0  " P * U0  " U 
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APPENDIX  D:  NOTATIONS  USED  IN  POWER  SYSTEM  EXAMPLE 


Notation  used  in  (5.63) 


rotor  angle  of  machine  i in  electrical  radians. 

2 

inertia  constant  of  machine  i in  sec  /elect,  rad. 
input  power  to  machine  1 in  per  unit. 

voltage  behind  transient  reactance  of  machine  i in  per  unit, 
per  unit  magnitude  of  the  ij**1  element  of  the  reduced  network 
admittance  matrix. 

angle  in  radians  of  the  i element  of  the  reduced  network  admittance 
matix. 


Notation  used  in  (5.65) 


M * M2  + M^ 


<i£>2  " £ ‘ + (M  + i^)2sin2ei2’tanY12 


.1  K tan  012 
Si  ■ Mx; 


, 1 .2  _ ,1  1.2  2a  . /I  x lv2  . 2,  _ w 

" (5  " M^>  008  013  + (M  + S?  8in  913*tanY13 


(-  + — ) 

M M1 

~A  T7  tan  9 13 

*M  “ Mj 


^ - (r2  - + + ^2*1"2923-“"T23-  ^ t,n  V 

S M3 
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